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High  Performance  Computing  (HPC)  technologie  omvat  het  op  schaalbare  wijze  aanwenden  van 
methoden  voor  parallel  en  gedistribueerd  rekenen.  Deze  technologie  is  sterk  in  opkomst  vanwege 
dc  vele  t^licades  die  nu  realiseerbaar  worden.  FEL-TNO  heeft  in  de  afgelopen  jaren  haar 
expertise  op  het  gebied  van  de  HPC  hard-  en  software-onnvikkeling  dan  ook  aanzienlijk 
uitgebreid  ten  behoeve  van  zowel  Eiefensie  als  de  civiele  markt.  £>e  geneeskunde/ 
gezondheidszorg  is  66n  van  de  gebieden  waarin  Defensie  en  de  civiele  markt  elkaar  deels 
overls^jpcn.  Om  de  bcrbxoikbaarheid  van  onderzoeksresultaten  na  te  streven,  ligt  het  voor  de  hand 
om  eerst  de  geneeskunde/gezondheidszorg  "in  kaart  te  brengen"  gezien  vanuit  Defensie  en  de 
civiele  markt. 

Het  doel  van  het  onderzoek  is  dan  ook  het  geven  van  een  overzicht  van  mogelijke  gebieden  in  de 
geneeskunde/gezondheidi^zorg  waar  High  Performance  Computing  nodig  wordt  geacht  vanuit  de 
visie  van  de  eindgebruiker.  Daamaast  wordt  een  mogelijke  wijze  voorgesteld  om  de  markt  voor 
deze  gebieden  te  benaderen. 

Deze  medische  gebieden  worden  met  zekae  details  omschreven,  teneinde  een  begrip  voor  de 
toepassingsgebieden  na  te  streven.  In  alle  onderzochte  toepassingesgebieden  staat 
beeldinterpretatie  centraal.  Medische  beeldinterpretatie  door  beeldverweiking  behelst  het 
verbeteren  van  de  kwaliteit  van  beelden  teneinde  medische  diagnostiek,  thenpie  en  chirurgie  te 
ondersteunen.  Globaal  zijn  er  vier  onderdelen  in  het  beeldverwerkingsproces,  te  weten: 
i)  datafosie;  ii)  object/kemnerk-extractie;  iii)  analyse  en  iv)  visualisade.  Met  de  introduktie  van  de 
Computer  Tomografie  (CT)  en  beeldvorming  op  basis  van  Magnedsche  Resonantie  (MRI) 
kunnen  driedimensionale  (3D)  beelden  worden  gemaakt  van  het  inwendige  van  de  mens.  Het 
bewerken  van  3D  beelden  op  zodanige  wijze  dat  de  tijd  die  daarvoor  nodig  is  binnen  aan- 
vaardbare  grenzen  blijft,  maakt  het  gebruik  van  High  Perfomumce  Corrputing  technieken 
wenselijk.  Huidige  (commerciele)  implementaties  behalen  niet  de  performance  die  vereist  is  in  de 
medische  kliniek,  waardoor  routinematig  gebruik  vcclal  tegen  hoge  personeelskosten  wordt 
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uitgevoeitL  Modules  voor  3D  datafiisie,  3D  objectdconnieric-extractie,  analyse  en  3D  visualisarie 
zouden  in  bestaande  en  nog  te  ontwikkelen  mediache  systemen  kunnen  woiden  gqpast  voor 
interactieve  visualisade,  quandtadeve  analyse,  (inverse)  iadiodierqnq>lanning,  neurochinirgie- 
planning  en  oodersteoning  djdens  bet  uitvoeren  van  operaties.  GelDategreerd  in  een  High 
Performance  OmqKiting  Medical  bnage  hiterpretadon  System  (HIPMPS)  kunnen  deze  modulen 
aangewend  woiden  voor  de  ontwikkeling  van  anatomische  modellen  (databases)  voor  simulatoien 
en  tiainingsystenien  in  Viitual  EnvmMunents  voor  b.v.  de  evaluade  van  protocollen  voor  de 
behandeling  van  padiinten  onder  trauma-omstandigheden  (triage),  chiiurgie,  lehabilitade  en 
telemedicine.  Met  name  triagetraining  in  Virtual  Envinmments  zou  voor  Defensie  van  nut  kunnen 
zijn  gelet  op  de  toenemende  behoefte  aan  kwalitadef  hoogwaardige  opleidingsfaciliteiten. 
Toepassingen  van  telemedicine  zijn  voor  Defensie  van  belang  daar  waar  er  qaake  is  van 
toenemende  mobiliteit  van  eenheden  en  inzetbaariieid  in  landen  met  onvoldoende  geneeskundige 
infiastructuur. 

In  de  liteiamur  zijn  een  groot  aantal  methoden  beschieven  voor  de  realisade  van  bovengenoemde 
toepassingen.  Daarin  wordt  (nog)  zeer  weinig  gebruik  gemaakt  van  HPC-technologie.  De 
realisade  van  een  modulair  opgebouwd  "High  Performance  Coixq>uting  Medical  Image 
Inteipretadon  System"  (HIPMPS)  geeft  FEL-TNO  de  noogelijkheid  om  haar  expertise  aan  te 
bieden  aan  de  Nederlandse  en  Europese  civiele  medische  industiie  voor  beeldverweiking  en 
training,  en  de  mogelijkheid  om  anatomische  modeUen  te  realiseien  en  te  visualiseren  als 
essendeel  onderdeel  van  training-  en  simuladesystemen  in  Virtual  Environments  voor  de  militaire 
geneeskunde. 
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ABSTRACT 

The  objective  of  this  report  is  describing  a  brief  invectory  of  potential  areas  in  medicine  where 
High  Performance  Confuting  (parallel  and  distributed  computing)  technology  is  needed  fixrm  an 
end-user's  point  of  view.  The  potential  areas  are  described  in  detail  to  give  an  understanding  of 
what  it  is  all  about 

The  ccnnmonality  in  all  these  areas  is  image  interpretation.  Medical  image  interpretation  by 
processing  aims  at  improving  image  quality  and  helping  image  analysis  in  order  to  support 
medical  diagnosis,  therapy  and  surgery.  Globally,  four  subjects  can  be  distinguished,  including: 
i)  data  fusion;  ii)  object/feature  extraction;  iii)  analysis  and  iv)  visualisation. 

With  the  introduction  of  Conqruter  Tomogrrqrhy  (CT)  and  Magnetic  Resonance  Imaging  (MRI) 
three-dimensional  (3D)  images  can  be  aeguired  firom  patients.  The  processing  of  3D  images  such 
that  the  time  required  for  that  purpose  is  widiin  acceptable  limits  makes  the  use  of  High 
Performance  Computing  (HPQ  techniques  desirable.  Currently  (commercially)  available 
implementations  do  not  satisfy  the  performance  requirements  for  routine  use  in  a  clinical  setting, 
as  a  result  of  wich  such  systems  will  be  used  at  high  costs  of  persormel. 

High  Performance  Conqrudng  Medical  Image  Interpretation  include  data  fusion,  object/feature 
extraction,  analysis  and  visualisation  of  3D  medical  images.  Modules  for  these  purposes  may  be 
intregrated  in  existing  medical  systems  to  support  interactive  visualisation,  quantitative  analysis, 
(inverse)  radiotherapy  platming,  neurosurgery  planning  and  intraoperative  assistance.  Intregrated 
into  a  High  Performance  Conqiuting  Medical  Image  Interpretation  System  (HEPMPS)  one  has  the 
tools  for  developing  anatomical  models  (databases)  for  simulation  and  training  in  Virmal 
Environments  for,  e.g.  protocol  evaluation  under  trauma  conditions  (triage),  surgery, 
rehabilitation  and  telemedicine. 

SAMENVATTING 

Het  doel  van  het  voorUggende  nqrport  is  bet  geven  van  een  overzicht  van  mogelijke  gebieden  in 
de  geneeskunde  waar  High  Performance  Confuting  (parallel  en  gedistribueerd  rekenen)  nodig 
wordt  geacht  vanuit  de  visie  van  de  eindgebruiker.  Deze  medische  gebieden  worden  met  zekere 
details  omschreven,  teneinde  een  begrip  voor  de  toqrassingsgebieden  na  te  sbeven. 

In  alle  toepassingsgebieden  staat  beeldinterpretatie  centraal.  Medische  beeldinterpretatie  door 
beeldverweridng  behelst  het  verbeteren  van  de  kwaliteit  van  beelden  teneinde  medische  diagnos- 
dek,  therapie  en  chirurgie  te  ondersteunen.  Globaal  zijn  er  vier  onderdelen  in  het 
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beeldverweikingsproces,  te  weten:  i)  datafusie;  ii)  object/kenmerk-extractie;  iii)  analyse  en 
iv)  visualistatie. 

Met  de  introduktie  van  de  Con^uter  Tumografie  (CT)  en  beeldvorming  op  basis  van  Magnetische 
Resonantie  (MRl)  kunnen  diie-dimensionale  (3D)  beelden  woiden  gemaakt  van  bet  inwendige 
van  de  mens.  Het  bewerken  van  3D  beelden  op  zodanige  wijze  dat  de  tijd  die  daarvoor  nodig  is 
binnen  aanvaardbare  grenzen  blijft,  maakt  het  gebruik  van  High  Performance  Coiiqruting  (HPC) 
technieken  wenselijk.  Huidige  (commerciele)  implementaties  behalen  niet  de  performance  die 
verreist  is  in  de  medische  kliniek,  waardoor  routinematig  gebruik  veelal  tegen  hoge  personeels- 
kosten  wordt  uitgevoerd. 

High  Performance  Computing  voor  medische  Beeldinterpretatie  omvat  datafusie,  object/kenmerk- 
extractie,  analyse  en  visualisatie  voor  3D  medische  beelden.  Modules  voor  deze  doeleinden 
zouden  in  bestaande  en  nog  te  ontwikkelen  medische  sytemen  kunnen  worden  gepast  voor 
interactieve  visualisatie,  quantitatieve  analyse,  (inverse)  radiotherapieplaruung,  neurochinirgie- 
planning  en  ondersteuning  tijdens  het  uitvoeren  van  operaties.  Ge'mtregeerd  in  een  High 
Performance  Computing  Medical  Image  Interpretation  System  (HIPMPS)  kurmen  anatomische 
modeUen  (databases)  worden  ontwikkeld  voor  simulatoren  en  trainingsystemen  in  Virtual 
Environments  voor  b.v.  de  evaluate  van  protocollen  voor  de  behandeling  van  patienten  onder 
trauma-omstandigheden  (triage),  chinu-gie,  rehabilitie  en  telemedicine. 
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PREFACE 

This  doenment  contains  an  introductoiy  overview  (Chapter  1)  to  die  field  of  medical  imaging,  in 
which  die  various  imaging  modalities  are  characterised.  So  fsr,  die  consulting  physician  comes  to 
a  diagnosis  of  possible  diseases  on  die  basis  of  the  evaluadm  of  die  results  of  all  outcomes  of  the 
imaging  modalities,  eventually  assisted  by  conqputer  systems.  There  is  no  single  coo^iuter  system 
known  that  integrates  the  potentials  of  die  individual  imaging  modalities  into  a  consistent 
diagnosis.  This  is  mainly  attributed  to  the  huge  con^tational  task  to  be  performed  in  order  to 
process,  analyse,  interpret  and  combine  all  data.  With  the  recent  developmmt  of  High 
Performance  Computing  (HPQ  techniques  this  task  may  be  handled. 

HIPMPS  (Chipter  2)  is  a  High  Performance  Medical  Image  Interpretation  System  that  will  make 
use  of  the  latest  technology  in  die  field  of  high  performance  conpudng  (HPC)  to  perform  the  task 
of  integrating  multi-modality  data.  The  outcome  of  HIPMPS  can  be  used  for  scientific 
visualisation  purposes  (diagnostics),  robot  control  in  (neuro-)surgery,  neurosurgery  planning, 
radiotherrpy  planning  and  the  construction  of  Virtual  Reality-based  training  systems.  Therefore, 
advanced  algorithtns  for  3-D  image  irterpretation  have  to  be  adapted  towards  the  latest 
achievements  in  the  field  of  HPC  (Chtpter  3).  The  organisation  of  the  conputer  system  (Chapter 
4)  and  software  system  (Qupter  5)  are  suggested  while  image  formats  are  listed  (Qupter  6).  To 
have  easy  access  to  all  data  at  all  levels  at  all  times  an  advanced  database  management  system 
(Qupter  7)  is  proposed.  Readily  available  inu^e  processing  techniques  (Clupter  8)  and  pattern 
recognition  techniques  (Qupter  9)  are  collected  and  elaborated  upon  (Chapter  10).  The 
evaluation  of  techniques  and  a  demonstration  system  can  be  found  in  Qupter  11.  Oupicr  12 
highliglits  the  many  facets  of  the  management  of  computing  and  information.  The  legal  aspects  of 
computing,  including  patents,  are  considered  in  Ctupter  12  as  well.  A  possible  market  approach  is 
described  in  Chapter  13. 
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1  INTRODUCTION  TO  MEDICAL  IMAGING 

1 . 1  Imaging  systems  in  medicine 

Imaging  systems  are  applied  in  roughly  three  areas^  of  the  field  of  medicine: 

i)  diagnosis; 

ii)  therapy; 

iii)  surgery. 

These  areas  have  a  certain  amount  of  overlap  and  t^lications  can  be  found  for  both  experimental 
and  clinical  medicine.  The  largest  area  of  these  three  is  diagnosis,  including; 

i)  radiology; 

ii)  nuclear  medicine. 

In  radiology,  the  following  imaging  modalities  can  be  found: 

i)  Conventional  X-ray  imaging  (2-D  X-ray  imaging); 

ii)  Computer  Tomography  (CT)  (3-D  X-ray  imaging); 

iii)  Magnetic  Resonance  (MR)  imaging  (3-D  nuclear  magnetic  resonance  imaging); 

iv)  Magnetic  Resonance  Angiography  (MRA)  (3-D  nuclear  magnetic  resonance  imaging  of 
(coronary)  arterial  systems); 

v)  Angiography  (2-D  X-ray  imaging  of  arterial  systems); 

vi)  Digital  Subtraction  Angiography  (DSA)  (2-D  background-subtracted  X-ray  imaging  of 
arterial  systems); 

vii)  Arteriography  (2-D  X-ray  imaging  of  coronary  arterial  systems); 
iix)  Dual  Energy  Imaging  (2-D  subtracted  dual  energy  X-ray  imaging). 

Conventional  X~ray  imaging  is  carried  out  with  a  single  X-ray  source-image  intensifier  system. 
The  X-rays  are  emitted  by  the  source,  attenuated  by  body  organs  and  fall  upon  the  input  screen  of 
the  detector  system,  which  is  part  of  the  image  intensifier.  The  various  organs  can  be 
characterised  by  their  linear  attenuation  coefficient.  This  gives  rise  to  shadow  patterns  from  which 
the  diagnoses  can  be  made.  A  general  problem  arising  fiom  this  modality  is  the  detection  of  smaU 
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From  the  physics  pomt  of  view  one  can  distingnish  diree  types  of  data:  transmissioii,  emission  and  reflection  data. 
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details  especially  if  their  density  is  quite  similar  to  diat  of  the  surrounding  area.  Current  research 
aims  at  developing  detector  systems  with  high  image  contrast  (Amplified  Multiple  Beam 
Ecquilaisation  in  Radiology,  AMBER),  image  contrast  enhancenjent  techniques  (Delfino  (1987), 
Andress  and  Wils<»  (1991),  Khellaf  et  al.  (1991))  and  filmless  systems  (e.g.,  Shaber  et  al. 
(1989)).  The  images  are  usually  stored  on  cinefilm  and,  recently,  also  in  digital  format  (digital 
radiognq^y)  (Snoeren  (1991)).  Conventional  X-ray  imaging  is  applied  in,  e.g.,  chest  radiognqdiy 
and  orthodontics  (Scott  and  Symons  (1982)). 

Computer  Tomography  (CT)  applies  to  all  techniques  by  which  transaxial  sUces  of  an  object  are 
reconstructed  from  X-ray  transmission  projection  data.  Radon  (1917)  laid  the  mathematical  basis 
of  many  reconstruction  algorithms.  He  described  the  projection  by  transmission  of  an  object,  the 
Radon  transform,  and  the  reconstruction  of  the  object  from  the  projection  Hata  the  inverse  Radon 
transform.  The  first  practical  implementations  of  the  inverse  Radon  transform  in  the  field  of 
medicine  were  described  by  Cormack  and  Hounsfield,  who  shared  a  Nobel  prize  (1972)  for  this 
breakthrough  in  medicine.  Their  results  (e.g.,  Cormack  (1963,  1964)  and  Hounsfield  (1973)) 
initiated  an  avalanche  of  publications  on  implementations  of  the  inverse  Radon  transform.  The 
inqrlementations  varied  in  the  handling  of  the  projection  geometry,  the  interpolation  techniques 
involved,  the  filtering/windowing  functions  and  constraints  imposed  by  the  number  of  projections 
(Herman  (1980),  Kak  and  Slaney  (1987),  Natterer  (1986)).  Hrom  the  diagnostic  point  of  view, 
these  algorithms  show  a  large  variety  in  performance  (Vannier  et  al.  (1989)). 

The  reconstruction  of  organs  in  motion,  like  the  beating  heart,  from  X-ray  projection  data  rt;quires 
conq>lex  scanning  devices  for  ultra  fast  data  acquisition  and  reconstruction.  At  present,  two  such 
systems  are  known:  the  commercially  available  Imatron  ClOO  (Boyd  and  Lipton  (1983))  and  the 
experimental  Dynamic  Spatial  Reconstructor  (DSR)  (Ritman,  Robb  and  Harris  (1985)).  Research 
in  the  field  of  quantitative  CT  is  directed  towards,  among  odiers,  flow  velocity  (Song  and  Leahy 
(1991))  while  High  Performance  Computing  (HPC)  techniques  have  only  recently  been 
introduced  into  CT  (Cheng  et  al.  (1990)). 

Magnetic  Resonance  Imaging  (MRI)  is  a  diagnostic  technique  u.  measure  and  display  cross 
sections  of  human  organs.  Therefore,  the  Fourier  coefficients  of  the  proton  ^in  density  of  tissue 
are  acquired  arxl  reconstructed.  The  Fourier  coefficients  are  acquired  with  the  aid  of  magnetic 
fields  by  which  the  spins  of  hydrogen  atoms  in  the  human  body  are  forced  to  emit  radiation  with  a 
characteristic  frequency  at  each  point.  There  are  4  types  of  magnetic  fields  involved  (Hin^aw 
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and  Lent  (1983)): 

i)  a  strong  homogeneous  field  to  allign  the  spins  in  the  z-direction;  the  z-direction  is  the 
equilibrium  direction  of  the  spins; 

ii)  a  radio  fi'equency  pulse  (rf-pulse),  i.e.,  a  rotation  electromagnetic  field  in  the  xy-plane, 
which  is  iqjplied  for  a  very  short  time  to  force  the  spins  out  of  equilibrium; 

iii)  the  z-component  of  the  gradient  vector,  by  which  a  cross  section  is  selected; 

iv)  the  magnetic  gradient  field,  which  forces  protons  at  a  selected  position  to  resonate  with  a 
unique  fioquency. 

The  magnetisation,  which  is  the  spin  density  at  a  selected  position  and  time,  follows  the  so-called 
Bloch  equation.  In  this  equation  arise  two  relaxation  parameters,  T1  and  T2,  that  represent  the 
effect  of  the  relaxation  process  of  the  spins. 

T1  is  the  longitudinal  or  spin-lattice  relaxation  time  which  governs  the  evolution  of  the  spin 
density  in  the  z-direction  towards  its  equilibrium  value.  T2  is  the  transverse  or  spin-.«pin 
relaxation  time  which  governs  the  evolution  of  the  magnitude  of  the  transverse  spin  density 
towards  its  equilibrium  value  zero.  In  general,  T1  is  much  larger  than  T2.  The  receiver  coil  of  the 
MR-acquisition  system  measures  the  magnetisation  before  it  has  returned  to  equilibrium  and  an 
output  signal  is  generated  The  signals  collected  in  a  single  plane  are  reconstructed  into  a  cross 
sectional  image,  while  a  set  of  such  cross  sections  define  a  reconstructed  volume  (Morris  (1986)). 

Magnetic  Resonance  Angiogrephy  (MRA)  is  the  visualisation  of  vessels  (both  arterial  and  venous 
structures)  with  MRI.  Dispite  the  limited  spatial  resolution  of  MRI,  the  potential  of  visualising 
vessels  by  magnetic  resonance  imaging  techniques  has  been  demonstrated  (Laub  and  Bachus 
(1987)).  Research  into  this  aeld  is  still  at  hand,  especially  aiming  at  flow  velocity  analysis  (Izen 
and  Haacke  (1990))  and  tagging  techniques  (Prince  and  Veigh  (1992)),  and  techniques  to  reduce 
the  data  acquisition  tune  (Zwaan  (1991)).  Clinical  research  aims  at  developing  and  {qjplying 
intravascular  contrast  dyes,  like  Gadolineum  DTPA.  Although  MRA  is  still  in  an  experimental 
l^ase,  it  has  some  potential  advantages,  particularly  with  respect  to  coronary  and  cerebrovascular 
imaging.  Firstly,  blood  vessels  can  be  visualised  without  the  injection  of  contrast  dye.  Secondly, 
MRA  produces  direct  3-D  images  which  can  be  viewed  from  any  position.  Thirdly,  it  permits  the 
visualisation  of  vascular  morphology  and  pathology,  simultaneously  with  myocardial  or  cerebral 
tissue  discrimination.  This  latter  feature  is  particularly  appealing  for  stereotactic  planning  using 
one  single  procedure,  since  it  nukes  the  conq>lex  matching  of  different  imaging  modalities  (DSA, 
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CT,  MR)  obsolete. 

Angiography  makes  the  visualisation  of  vessel  possible.  Arterial  vessels  carry  blood  from  the 
heart  to  the  muscles  and  body  organs  while  veins  carry  the  blood  to  the  heart.  Imaging  of  vessels 
by  X-ray  techniques  has  become  indispensable  to  present  day  medical  practice.  To  visualise  blood 
vessels,  a  contrast  dye  is  injected  through  a  catheter  positioned  at  the  orifice  of  the  arterial  system 
of  interest  or  in  the  venous  system  when  veins  are  being  examined.  A  sequence  of  images  shows 
the  dilution  of  the  dye  with  blood  and  the  progression  of  this  mixture.  The  sequence  can  be 
acquired  at  a  speed  of  25  images  per  second,  which  is  a  European  standard,  or  30  images  per 
second,  which  is  an  American  standard.  Several  sequences  are  usually  acquired  from  different 
angiographic  views.  Complex  protocols  (e.g.,  Dumay  (1992))  are  carried  out  in  procedures, 
generally  called  catheteri-sation.  The  projected  sizes  of  vessel  segments  provide  information 
about  the  location  and  severity  of  possibly  existing  stenoses.  The  introduction  of  Quantitative 
(Coronary)  Angiography  (QCA)  techniques  (e.g.,  Reiber  and  Serruys  (1991))  has  made  it  possible 
to  obtain  parameters  which  are  objective  and  reproducible  from  a  morphology  point  of  view  and 
functionality  point  of  view  (Kirkeeide  (1991)). 

Digital  Subtraction  Angiography  (DSA)  visualises  the  progression  of  the  (coronary)  blood 
circulation  by  digital  enhancement  in  two  ways.  Fiist,  by  mask-mode  subtraction  through  serially 
subtracting  the  selected  image  before  contrast  medium  injection  from  subsequent  images  at  the 
same  phase  of  the  pulsatile  blood  flow  (heart  cycle).  ECG^gated  images  are  acquired  to  eliminate 
artefacts  resulting  from  cardiac  motion.  Second,  by  gated-interval-dme-differencing  where  each 
image  is  subtracted  from  the  corresponding  image  in  the  next  heart  beat.  In  the  latter  case  the 
resultant  images  visualise  only  new  appearance  of  contrast  medium  rather  than  their  instantaneous 
content.  DSA  is  used  in  patients  which  caimot  be  exposed  to  the  radiation  dosage  that  is  used  in 
conventional  angiography  and  in  the  investigation  of  time-related  phenomena  (Verhoeven 
(1985)). 

Arteriography  is  basically  the  same  as  angiography  though  the  techniques  are  tqrplied  to  the 
coronary  arteries  that  supply  blood  to  the  heart  muscle  (myocardium).  Research  in  this  field  aims 
primarily  at  developing  techniques  for  3-D  reconstruction  from  a  very  limited  number  of 
projections  (Dumay  (1992))  and  (intracoronary)  echocardiognqthy  (Rijsterborgh  (1990)).  Clinical 
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research  aims  at  developing  and  in^oving  intervention  techniques  like  Percutaneous 
Transluminal  Coronary  Angioplasty  (PTCA)  (Serruys  et  al.  (1991))  and  stenting  (Strauss  (1991)). 

Dual  Energy  Imaging  is  very  similar  to  DSA,  however,  the  mask-images  are  not  selected  under 
pre-contrast  dye  injection  conditions,  but  with  a  different  voltage  and  current  of  the  X-ray  tube. 
This  results  in  X-radiadon  with  different  energy  levels.  Ihe  subtraction  of  the  acquired  sets  of 
images  show  the  body  parts  of  interest  with  better  image  contrast  dian  when  the  subtraction  is 
omitted. 

In  Nuclear  Medicine,  two  imaging  modalities  can  be  found; 

i)  Single  Rioton  Emission  Computer  Tomogrtqjhy  (SPECT)  (3-D  gamma  imaging); 

ii)  Positron  Emission  Tomography  (PET)  (3-D  positron  imaging). 

Single  Photon  Emission  Computer  Tomography  (SPECT)  provides  techniques  to  reconstruct  the 
gamma-radiation  distribution  over  an  object  in  3-D  from  emission  projection  data.  The  images  are 
usually  reconstructed  using  Filtered  Backprojection  (FB)  techniques  with  filter  specifications 
(King  (1983),  Hentea  and  Hawman  (1987))  adiqjted  to  the  sensor  system  (Modulation  Transfer 
Function,  MTF)  and  object  characteristics  (Prati  (1987)).  Research  towards  statistically-based 
reconstruction  techniques  in  this  field  is  in  full  swing  (Ollinger  (1990),  Liow  and  Strother  (1991)). 

With  SPECT  the  metabolism  of  a  radiolabelled  carrier  with  tissue  can  be  visualised.  total 
amount  of  uptake  of  a  nuclear  tracer  depends  on  the  blood  supply  to  the  tissue  cells  and  tL.,  olood 
(or  oxygen  02)  demand  (L'Abbate  (1991),  van  der  Wall  et  al.  (1991)).  Automated  techniques  for 
analysis  purposes  are  more  or  less  accepted  in  clinical  practice  (Nuyts  (1991)). 

Positron  Emission  Tomography  (PET)  has  become  a  powerful  tool  to  measure  regional,  in  vivo 
distributions  of  various  conqxmnds.  Quantitative,  functional  data  are  generated,  which  provide 
insights  into  the  pharmacological  and  physiological  behaviour  of  tissue.  PET  tracers  presently  in 
use  enable  the  study  of  blood  flow,  metabolism  and  rec^tor  bindings  in  humans.  With  the 
continuing  developments  in  high  resolution  PET  detectors  the  possibilities  exist,  in  the  first  place 
in  experimental  animals,  to  measure  full,  regional  tissue  time  course  of  the  tracer  in  individual 
animals.  The  benefits  of  following  the  arterial  time  course  using  noninvasive  sampling  are 
apparent  in  terms  of  time  saved  in  catheterization  and  patient  discomfort. 
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One  of  the  main  problems  which  has  to  be  addressed  in  the  design  of  positron  tomographs  is  the 
optimization  of  the  spatial  resolution  while  still  maintaining  detection  efficiency:  reducing  the 
iiq>ut  crystal  size  in  2-D  arrays  in  order  to  achieve  higher  resolution  results  in  lower  light 
collecticMi  efficiency  and  energy  resolution  (Rajeswaran  et  al.  (1992)).  High  performance 
computing  techniques  have  already  been  applied  in  PET  imaging  (Wilkinson  et  al.  (1989),  Barresi 
etal.(1990)). 

Ultrasound  Techniques  are  non-invasive  and  can  be  applied  under  bedside  conditions, 
(^antitative  ultrasound  has  become  an  iirqKjrtant  diagnostic  tool  in  clinical  decision  making, 
especially  in  cardiology.  The  measurement  of  specific  parameters  of  organ  function  by  cross- 
sectional  echography  and  by  Doppler  echography  help  to  differentiate  between  normal  and 
abnormal  function  and  to  assess  the  severity  of  the  disease.  At  present,  the  reproducibility  and 
calibration  of  echo(cardio)grtq>hic  images  is  limited  (Bohs  and  Trahey  (1991),  Ten  fair  et  al. 
(1991)),  which  makes  quantification  of  ultrasound  images  a  tedious  task  (Rijsterborgh  (1991)). 
Transoestqihageal  echo  transducers  provide  unrestricted  access  to  ultrasonic  sectional  images  of 
the  heart,  but  is  limited  by  varying  transducer  positions  and  thus  produce  different  imaging 
planes.  Technological  developments  aim  at  3-D  acquisition  of  images  of  the  beating  heart 
(WoUschlager  et  al.  (1989))  which  are  applied  during  cardiac  surgery  to  monitoring  the  conditions 
of  the  heart. 

Images  produced  by  these  imaging  modalities  are  used  for  visual  interpretation  and  computer- 
assisted  analysis  (van  der  Wall  (1992),  Marcus  et  al.  (1991)). 

In  therapy,  the  forementioned  imaging  modalities  are  used  to  evaluate  intervention  techniques 
(e.g.,  SoTuys  et  al.  (1991))  and  radiothenpy  planning. 

In  surgery,  die  forementioiied  X-ray  imaging  nxidalities  are  used  for  planning  (especially  for 
neuro-surgical  planning  and  stereotactic  surgery). 

Radiotherapy  requires  careful  planning  in  order  to  deliver  a  sufficient  level  of  radiation  to  the 
target  tissue  while  minimising  the  dose  to  surrounding  (healthy)  tissues.  Today,  there  exist  many 
elaborate  con^ter  programs,  which  allow  the  computation  of  mor  eor  less  conplex  treatment 
plans,  but  the  step  to  dynamic  therapy  methods  has  not  yet  been  taken  due  to  the  increase  of  the 
conputation  time.  Consequendy,  the  methods  involved  are  not  pplicable  in  daily  routine,  since 
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conventioiial  conq>uter  equipmcDt  cannot  meet  the  constraints  of  interactive  computer  simulation. 

Inverse  Radiotherapy  Planning  (IRP)  and  Conformal  Radiotherapy  Planning  (SRP)  (Webb  1989, 
1991a,  1991b,  1992)  involve  the  computation  of  the  position  and  energy  level  of  the  radiation 
source,  given  the  position  and  size  of  the  body  organ  to  be  treated  and  satisfying  the  constraint  to 
minimally  damage  other  body  parts. 

Stereotacticai  (neuro-)  surgery  requires  the  assessment  of  the  target  volume  and  position  as 
prerequisites  for  successful  treatment  planning  of  brain  tumours  (Nuyts  (1991)).  During  the 
operation  an  electrode  is  directed  into  the  target  area.  At  that  region,  nerve  fibers  should  be 
distroyed  for  therapy  by  electrotheimo-coagulation.  Unfortunately,  the  target  area,  at  which  the 
nerve  fibres  should  be  coagulated,  cannot  directly  be  obtained  from  neuro-anatomical  stmctures 
displayed  by  X-ray  (including  CT-scans)  or  MRI.  Therefore,  the  area  of  interest  is  explored 
conventionally  by  electrophysiological  stimulations,  done  by  an  electric  stimulator  when  the 
electrode  had  reached  that  region.  According  to  sensory  or  motoric  reactions  of  the  patient  after 
such  stimulations  the  region  at  which  coagulations  should  be  carried  out  most  often  can  be 
localised  by  that  method.  Research  in  this  field  aims  at  referring  stimulation  and  coagulation  sites 
to  anatomical  structures  (Nuyts  (1991)). 

1 .2  2-D  image  interpretation 

Planar  (2-D)  images  are  acquired  with  the  use  of  X-ray  techniques  and  ultrasound  techniques. 
The  interpretation  of  these  images  requires: 

i)  object  extraction  (segmentation); 

ii)  object  feature  extraction  (analysis); 

iii)  feature  interpretation  (classification). 

To  achieve  these  goals,  a  great  number  of  techniques  are  available  from  literature.  These 
techniques  perform  with  more  or  less  success  under  laboratory  conditions  and  some  of  them  have 
found  their  way  to  the  clinics.  Especially  techiques  operating  on  3D  images  lack  the  performance 
required  for  routine  use.  To  extract  objects  from  images  general  purpose  and  dedicated  filtering, 
and  knowledge-based  techniques  are  available.  Analysing  an  object  requires  domain-knowledge 
which  makes  generalisation  difficult.  To  classify  an  object,  the  domain  of  pattern  recognition  can 
be  exploited. 
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1.3  3-D  image  inteipietalioii 

All  that  qyplies  to  2-D  image  interpretation  qrplies  to  3-D  image  interpretation  as  well.  However, 
to  gain  the  full  potential  from  the  additional  dimensionality  multi-resolution  techniques  should  be 
^rplied  to  extract  objects  from  the  data. 

1 .4  Advanced  medical  imaging  applications 

Advanced  medical  imaging  rqrpUcations  can  be  found  in: 

i)  computer-assisted  stereotactic  neurosurgery; 

ii)  (reconstructive)  surgery  simulation; 

iii)  conqmter  integrated  manufacturing  (OM)  of  reconstructed  bone  structures; 

iv)  radiadon-thenqry  planning; 

v)  anatomical  encyclopaedia. 

Computer-assisttd  stereotactic  neurosurgery  is  defined  as  the  flexible,  on-line,  intelligent  and 
integrated  use  of  all  available  radiological,  patient-qrecific  data  as  weU  as  anatomical,  generic 
nxxlels  extracted  from  stereotactic  atlases.  Images  are  acquired  using  a  patient-fixed  stereotactic 
frame  with  accessory  locating  devices  for  CT,  MRl  and  DSA.  A  first  step  is  the  localisation  of  the 
landmarks  in  aU  images.  Up  to  now  the  positions  of  these  landmarks  are  manually  defined.  The 
landituuks  enable  the  transformation  of  all  image  data  to  the  stereotactic  firame  coordinates. 
Lesions  are  (usually  manually)  outlined  in  CT  and  MR  images.  Fiiudly,  all  data  are  made 
available  for  stereotactic  planning  and  confirmation  of  electrode  positioning.  With  interactive 
simulation  the  electrode  trajectory  can  be  vitalised  and  a  fall-safe  trajectory  can  be  chosen, 
avoiding  cerebral  vessels  and  vulnerable  anatomical  regions.  Image  data  can  be  reorganised  in 
slices  perpendicular  to  the  surgical  probe,  offering  additional  orientation  and  crmfiimation  clues 
to  the  surgeon  (Vandermeulen  (1991)).  An  overview  of  currently  available  stereotactic  frames  can 
be  found  in  Kelly  (1991).  During  the  operaticm  an  electrode  is  directed  to  a  target  area.  At  that 
region,  nerve  fibers  should  be  distroyed  for  tbenq>y  by  electrotheimo-coagulation.  Unfortunately, 
the  target  area,  at  which  die  nerve  fibres  should  be  coagulated,  carmot  directly  be  obtained  fitnn 
neuro-anatondcal  structures  disputed  by  X-ray  (including  CT-scans)  or  MRI.  Therefore,  the  area 
of  interest  is  eiqplored  conventionally  by  electrophysiological  stimulations,  done  by  an  electric 
stimulator  when  the  electrode  had  reached  diat  region.  According  to  sensory  or  motoric  reactions 
of  die  patient  after  such  stimulations  the  region  at  which  coagulations  should  be  carried  out  most 
oftra  can  be  localised  by  diat  method.  Research  in  this  field  aimit  at  referring  stimulation  and 


TNOrvpott 


Page 

18 


coagulation  sites  to  anatomical  structures. 

Reconstructive  surgery  simulation  allows  the  visualisation  of  the  results  of  reconstructive  surgery 
on  the  basis  of  analysed  CT  or  MR  images.  Prototype  systems  can  be  found  in  the  area  of 
craniofacial  surgery  (McEwan  (1989)). 

Minimal  Access  Surgery  (MAS)  or  Minimally  Invasive  Surgery  (MIS)  is  a  rather  new  technique 
emerging  from  the  field  of  ltq>aroscopy.  Following  MAS  protocols,  instruments  for  surgery  and 
miniscule  light  sources  are  inserted  into  the  human  body  through  natural  openings  or  small  holes 
cut  for  that  purpose.  With  minimal  damage  to  the  outside  of  the  patient,  surgery  procedures  can 
be  carried  out.  Training  of  these  procedures,  however,  requires  postmortem  animal  and  human 
bodies,  and  living  volunteers.  Training  of  these  procedures  in  a  Virtual  Enviroiunent  would  makes 
these  prerequisites  immaterial. 

However,  at  present  there  is  little  known  about  mathematical  models  of  deformable  soft  bodies 
and,  consequently,  research  in  this  field  is  required. 

Computer  integrated  manirfacturing  of  reconstructed  bone  structures  has  been  demonstrated  by, 
e.g.,  Schitz  et  al.  (1989),  who  made  use  of  processed  CT  images,  manually  adapted  geometric 
models  and  numerically-controlled  manufacturing  equipment. 

Radiation-therapy  planning  can  be  carried  out  with  similar  techniques  as  used  in  computer- 
assisted  stereotactic  neurosurgery.  These  techniques  must  be  extended  with  dose  calculation, 
especially  with  methods  for  Iverse  Radiotherapy  Planning  (IRP)  and  Conformal  Radiotherapy 
Planning  (CRP)  (Webb  1989,  1991a,  1991b,  1992).  For  radiotherapy  planning,  the  target  area  is 
to  be  exposed  to  radiation  such  that  surrounding  tissue  is  minimally  exposed.  The  radiation  dose 
to  be  calculated  depends  on  the  nature  of  the  pathology,  the  tissue  in  which  it  manifests,  the 
stractures  to  be  irradiated  and  the  location  of  the  target  area. 

Anatomical  encyclopaedia  are  useful  for  educational  and  diagnostic  purposes.  An  important  task 
of  the  padiologist  is  the  classification  and  grading  of  tissue  abnormalities  by  visual  examination 
of  histologic  and  cytological  slides  in  the  context  of  the  clinical  history  of  the  patient.  The 
interpretation  of  die  images  by  the  pathologist  may  involve  consultation  of  textbooks  and 
colleagues  for  reference.  A  pathology  diagnosis  covers  a  range  of  tissue  abnormalities.  Due  to 
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differences  in  education  and  e^qperieDce,  experts  do  not  always  use  die  same  criteria  for  defining 
such  a  range  and  they  may  also  differ  in  dieir  interpretation  of  findings.  As  a  result,  experts  may 
disagree  about  die  diagnosis  of  a  case.  Techniques,  some  of  dion  involving  conqniter 
i^licadons,  have  been  devehqied  to  enhance  consistency  in  pathology  diagnosis.  Widi  respect  to 
their  goals,  van  Ginneken  (1989)  divides  diese  terhnigneg  into  two  main  categories: 

i)  increasing  objectivity  in  die  acquisition  and  interpretation  of  diagnostic  data; 

ii)  promoting  the  accessibility  and  utilisation  of  reference  knowledge  for  classification  and 
grading. 

The  first  category  includes  morphometry,  image  processing  and  statistical  pattern  recognition, 
whereas  the  second  category  encompasses  the  computerisation  of  patient  archives,  the  storage  of 
pictures  on  optical  discs  and  decision  support  systems.  Thou^  these  techniques  and  coiiqiuter 
triplications  perform  their  specific  tasks  adequately,  they  share  one  or  more  of  the  following 
limitations  (van  Ginneken  (1989)): 

i)  limited  sqiplicability  and  scope; 

ii)  too  much  emidiasis  on  decision  support  based  on  findings  solely; 

iii)  poor  facilities  for  knowledge  acquisition. 

Atlases  of  the  human  anatomy  are  readily  available.  Visualisation  of  the  anatomy  in  a  virtual 
mvironment  has  not  been  demonstrated  yet,  though  pioneering  work  towards  that  purpose  is 
under  way  (Satava  (1993),  Dumay  and  Jense  (1993),  Dumay  (1993)). 
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2  HIPMPS 

2.1  Introduction 

A  High  Perfonnance  Medical  Image  Intetpr^ation  System  (HIFMPS)  is  constructed  from  hard- 
and  software  modules  for : 

i)  fusing  3-D  medical  images  from  multiple  modalities; 

ii)  extracting  objects  from  3-D  data; 

iii)  delineating  object  features; 

iv)  interpreting  the  object  features  by  model-based  techniques; 

v)  interactive  visualisation. 

This  cluster  is  dedicated  towards  specifying  explicitly  the  purpose  of  HIFMPS  and  summing  up 
the  system  and  functional  requirements. 

2.2  Purpose  of  the  system 

HIFMPS  imparts  (series  of)  volume  data  frxnn  multq>le  medical  imaging  noodalities  like 
Conqiuter  Tomogrrqrhy  (CT)  scanners.  Magnetic  Resonance  (MR)  scanners.  Single  Photon 
Computer  Tomognq>hy  (SPECT)  scanners  and  Positron  Emission  Tonx>gnq>hy  (PET)  scanners. 
With  HPC  iiiq>leinentations  one  may  acquire  state-of-the-art  building  blocks  for  data  fusion, 
object^eature  extraction,  analysis  and  visualisation.  Widi  these  building  blocks  a  treatment 
planning  system  for  a  wide  range  of  applications  in  computer-assisted  surgery  and  radiotiierapy 
platming  systems  can  be  conquleu  These  systems  should  have  a  performance  and  reliability  that 
suits  clirucal  requirements.  On  the  odier  hand,  die  modules  diould  be  flexible  enou^  to  adiqKing 
to  future  developments  in  bodi  hard-  and  software  technology.  Witii  the  modules  of  HIFMPS, 
anatomical  models  of  (parts  of)  die  human  body  can  be  extracted  and  stored  into  databases 
embedded  in  Virtual  Reality  systems  for  training  and  simulation. 

HIFMPS  processes  die  individaal  volume  data-sets  by: 

i)  object  segmentation; 

ii)  object  feature  extraction; 

iii)  model-based  object  interpretation; 

iv)  object  analysis. 
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and  i4>plies  data  fiiaioa  (c.f.,  e.g.,  MeShan  and  Fraaaa  (1987),  Hawkes  et  aL  (1992)  and  van  den 
Elsen  et  al.  (1993)  and  van  den  Elaen  (1993))  at  ^ipropriate  levels  of  die  data  processing. 
HIPMPS  leqxMids  widi: 

i)  data  fusion  of  selected  3-D  images; 

ii)  highly  reliable  and  rqaoducible  object  shqie  and  position  representations; 

iii)  accurate  and  reproducible  descr^timis  of  selected  object  features; 

iv)  high  performance  (interactive)  visualisation. 

The  concqit  of  HIPMPS  is  certainly  not  unique.  Bodi  die  idea  to  qiply  it  to  radiothenqiy  (Wemet 
et  al.  (1987))  and  stereotactic  (neuro-)  surgery  (Doll  et  al.  (1987),  Kwoh  et  aL  (1987),  T-ipinski  et 
al.  (1987),  Vandermeulen  (1991))  are  bonowed  from  die  literature.  A  tutorial  on  presentation 
techniques  in  medical  visualisation  techniques  can  be  found  in,  e.g.,  Pizer  and  Fuchs  (1987).  In 
the  field  of  stereotactic  surgery  THE  VIEWING  WAND^  is  commercially  available,  while  for 
treatment  planning  the  SLP  3-D  Treatment  PLanning*  system  is  available.  There  are  no 
commercially  available  training  and  simulaticm  systems  known.  What  is  new  to  this  concept  is  the 
fact  that  High  Performance  Conqniting  techniques  are  introduced  to  achieve  a  high  level  of  user- 
fiiendliness  which  most  (if  not  all)  interactive  systems  lack  in  handling  3-D  images. 

2.3  System  requirements 

The  following  constraining  requirements  must  be  satisfied  by  the  system  configuration: 

i)  memory  ciqiacity  to  handle  data-sets  iqi  to  512x5 12x5 12  voxels  with  12  bits  voxel  data; 

ii)  19"  flicker-firee  RGB  video  display  monitor  (1280x 1024  pixels) 

iii)  optical  or  mechanical  mouse  and  keyboard; 

iv)  no  dedicated  hardware; 

v)  video  hard  oapy  unit,  laser  printer,  external  disk  memory;  quarter-inch  cartridge  tape  drive, 
ethemet  board 

vi)  scalable  perfoimaiice  transputer  networks; 

vii)  "low-cost"; 

viii)  portable  software. 
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OptionaL 

ix)  display  with  Higb  Definition  Television  (HDTV)  video  standard  (1920x1280  pixels). 

2.4  Functional  requirements 

The  following  fimctiaoal  requirements  must  be  satisfied: 

i)  Unix-based  operating  system.  C-programming  language 

Oii)  menu-driven  man-machine  interface ,  X-windows,  MOTEPF  (Wedlei  (1989)); 

iii)  instructive  emv  repenting: 

iv)  voxel  data-set  rendering  (including  data  ciq>ping)  fixnn  arbitrary  viewpoint  by: 

parallel  projection 
perspective  projection 
depth  shading 
voxel  data  read-out 
layer  view 
wireframe 
transparent  view 

-  solid  modelling  (surface  rendering) 

combination  of  different  rendering  techniques 

v)  hidden  surface  elimination: 

vi)  selection  of  rectangular  volume-of-inteiest; 

vii)  interactive  visualisation  by: 

window-width  and  window-level  setting 

rotation  and  translation 

zoom 

pan 

iix)  2-D,  3-D  and  4-D  (3-D  series)  image  processing,  including: 
noise  reduction 
edge  enhancement 
smoodiing 

geometric  distortion  correction 
correction  for  transfer  function 
knowledge-based  image  segmentation 
multi-tesohition  segmentation 
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ix)  2-D,  3-D  and  4-D  (3-series)  object  tecognitioii,  including; 

niult^le  modality  confinnation 
knowledge-based  leasooing 

x)  moltqile  image,  text  and  gnfihics  windows  simultaneously. 

2.5  Spin-in 

A  prototype,  reconfigurable,  transputer-based  computer  system  for  voxel  data  processing  is 
already  available  (Huiskan^  and  van  Lieshout  (1989,  1990),  Huiskamp  (1991)).  This  system  is 
capable  of  voxel  visualisation  including; 

i)  hidden  surface  elimination  (2^bufEering,  Painters  algorithm); 

ii)  front  view  tendering; 

iii)  depth  shading; 

iv)  voxel  value  integrated  di^lay; 

v)  layer  di^lay. 

The  voxel  processing  system  utilises  data  parallelism  rather  than  algorithmic  parallelism,  which 
makes  it  scalable  frtxn  the  hardware  point  of  view  (Huiskamp  (1991)).  This  prototype  voxel 
processing  system  is  suitable  as  a  point  of  departure. 

The  concept  of  computer-assisted  radiotherapy  planning  (Wemet  et  al.  (1987),  Lipinsld  et  al. 
(1987))  and  con^uter-assisted  stereotactic  (neuro-)  surgery  planning  and  robot  control  (Doll  et  al. 
(1987),  Kwoh  et  al.  (1987))  have  been  demonstrated  to  be  feasible. 

2.6  Spin-off 

High  performance  image  interpretation  arxl  visualisation  find  not  only  i^lications  in  rxredicine.  It 
may  find  qrplicatioiis  in: 

i)  Confocal  Laser  Scanning  Microscc^  (CLSM)  (see  Huiskamp  (1991)); 

ii)  3'D  geophysics. 
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3  fflGH  PERFORMANCE  COMPUTING 

3.1  Introduction 

The  industrial  development  and  exploitation  of  information  technology  have  greatly  enhanced 
human  capabilities  and  knowledge.  The  application  of  information  technology  has  led  to  major 
breakthroughs  in  industrial  and  commercial  competitiveness,  scientific  knowledge  and  the  quality 
of  life.  The  leading  edge  of  information  technology  has  been  the  pursuit  of  faster  and  more 
powerful  computing  techniques,  enhanced  by  their  interconnection  via  networks.  Recent 
technological  developments  promise  quantitative  and  qualitative  changes  in  performance  that 
could  permit  information  technology  to  address  as  yet  unresolved  fundamental  problems  and  to 
contribute  improvements  of  industrial  competitiveness. 

Computing  performance  evolved  rapidly  and  led,  during  the  1970's  and  1980's,  to  super 
conqjuters  using  a  few,  very  fast  processors  (each  currently  able  to  sustain  a  performance  of  up  to 
one  thousand  million  operations  per  second)  at  a  cost  of  millions  of  EClTs  per  system.  At  the 
same  time,  specialised  users  developed  very  high  performance  computing  techniques  (e.g.,  radar 
data  processing)  embedded  in  operational  systems. 

Between  now  and  the  year  2,(XX)  this  evolution  is  expected  to  become  a  revolution.  The  advent  of 
a  novel  generation  of  parallel  con^tuters,  based  on  the  principle  of  numy  processors  (up  to  a 
thousand)  working  together,  will  simultaneously  allow  an  increase  in  performance  of  super 
conq>uters  by  a  factor  1,000  or  more  (one  million  million  operations  per  second  is  considered 
feasible)  and  permit  high  performance  computing  to  be  embedded  in  new  products  and  systems. 
At  the  same  time,  new  software  methods  and  improved  conqiutatioDal  models  will  result  in  a 
greater  flexibility  in  adapting  these  con^iutational  resources  to  the  needs  and  means  of  users 
(CEC  (1992)). 

3.2  Parallel  processing 

Computer  applications  tend  to  need  increasing  amounts  of  processing  ciq>acities.  Single  processor 
systems  are  reaching  the  limits  of  performance  improvements.  It  is  obvious  that  using  more 
processors  running  in  parallel  could,  at  least  in  principle,  provide  unlimited  power.  Most  existing 
multi-processor  systems  use  a  common  communications  channel  (the  bus)  for  interconnections. 
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With  a  growing  number  of  processors  the  bus  capacity  becomes  a  bottle-neck  for  system 
performance.  Communication  bandwidth  of  the  network  must  be  increased  also  when  processors 
are  added.  Providing  processors  with  direct  connections  for  all  data  exchange  wiU  supply 
increased  bandwidth. 

Several  classes  of  multi-processor  systems  have  been  defined  (Furfat  (1989)); 

i)  Single  Instruction  Multiple  Data  (SIMD).  Each  processor  in  the  network  will  execute  the 
same  instruction  (synchronously)  on  different  data.  Array  processors  fall  in  this  class.  SIMD 
is  ^plied  in,  e.g.,  image  processing  where  each  processor  performs  the  same  (filter) 
operatioo  on  a  different  part  of  the  image. 

ii)  Multiple  Instruction  Multiple  Data  (MIMD).  Processors  can  all  be  running  different 
programs,  sending  results  to  others  when  they  have  finished.  MIMD  is  applied  in,  e.g., 
pipelined  systems  or  multi-user  applications. 

Many  existing  sequential  programs  could  benefit  fiom  being  able  to  perform  more  than  one  action 
at  a  time.  It  is,  however,  generally  not  trivial  to  implement  a  parallel  program  on  a  network 
processor.  Problems  arising  include; 

i)  decomposition  of  the  problem  into  a  number  of  processes  running  in  parallel; 

ii)  allocation  of  processes  to  processors  and  selection  of  the  network  topology , 

iii)  load-balancing  of  the  prxKessors; 

iv)  distribution  of  the  data  over  the  processors; 

v)  efficient  inter-processor  communication; 

vi)  synchronisation  of  processors; 

vii)  debugging  the  software  implementation. 

3.3  Artificial  Neural  Networks 

Artificial  Neural  Networks  (ANN)  are  relatively  new  coopting  systems  whose  architecture  is 
made  of  a  massive  number  of  densely  interconnected  sinq>le  analog  processing  elemmts.  The 
processing  is  done  in  parallel  either  in  a  synchronous  or  asynchronous  mode.  The  architecture  of 
ANN  is  modelled  after  the  human  -n^ous  system  with  some  unique  processing  c{q>abilities 
which  are  not  found  ta  the  conventional,  sequential  coiiq>uting  system.  One  such  processing  task 
in  which  the  ANN  exels  is  in  the  area  of  pattern  recognition.  All  reported  ANN  architectures  have 
used  a  specific  structure,  known  as  generalised  perceptions  (GP)  or  back  propagation  networks 
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(BPN).  These  networks  use  a  training  set  very  similar  to  the  conventional  supervised  methods, 
vnth  the  exception  that  no  a  priori  probabilistic  knowledge  is  required  (similar  to  the  conventional 
nonparametric  methods)  (Lippmann  (1987)).  Neural  networks  have  found  {qrplicadons  in  control 
systems  as  well  (Antsaklis  (1992)). 

Another  neural  architecture  which  has  attracted  considerable  attention  in  the  recent  past  was 
proposed  by  Hopfield  (Hopfield  (1982)).This  type  of  network  has  been  proposed  for  the 
unsup>ervised  classification  of  patterns:  images  modeUed  as  a  Maikov  random  field  can  be 
assigned  region  labels  or  pixel  labels  by  minimising  the  expected  percentage  of  misclassificd 
pixels  on  a  Hopfield  network  (Rignot  and  Chellapa  (1991)).  With  a  Hopfield  network  an  energy 
function  can  be  minimised.  An  extensive  overview  of  the  progress  achieved  in  supervised  neural 
networks  can  be  found  in  Hush  and  Home  (1993). 

3.4  European  Industry  Initiative  Ei3  for  High  Performance  Computing 

The  European  Industry  Initiative  (Ei^)  exists  to  act  as  a  forum  for  industrial  and  commercial  users 
of  HPC  to  discuss  their  requirements  and  make  recommendations  to  various  national  and 
supranational  bodies  working  in  HPC  and  related  areas.  Initially,  EP  aims  to  assist  the  CEC  in  the 
definition  of,  and  launching  process  for,  the  HPC  programme  with  a  clear  industry  perspective  of 
the  field  and  its  needs  to  maintain  competitiveness  in  the  global  market.  Although  the  position  of 
the  European  industry  is  fairly  strong  in  particular  areas  to  HPC,  we  badly  need  a  broad  HPC 
applications  industry  and  the  necessary  infiastructure.  Ei^  as  an  ^plications-driven  industrial 
grouping  strives  to  ensure  that  this  aim  is  realised  through  the  synergy  between  EP,  its  associates, 
the  CEC  and  other  national  and  supranational  bodies. 

Ei^  aims  in  particular  at: 

i)  providing  a  platform  for  interested  parties  to  discuss  their  HPC  needs  and  to  focus  their 
requirements; 

ii)  developing  an  industrial  HPC  strategy  and  programme  by  bringing  together  iqjplication 
developers  and  technology  providers.  Ei^  believes  that  a  big  thrust  will  come  from 
innovative  industrial  application  areas  in  particular  the  real  time  arena; 

iii)  fostering  standardisation  wherever  possible,  the  actual  lack  of  it  being  a  major  obstacle  to  a 
parallel  conqniting  industry; 
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iv)  identifying  die  needs  for  training,  technology  transfer  and  other  siqipoiting  infrastructure  for 
HPC; 

v)  assisting  die  CEC  in  defining  and  launching  HPC  as  a  Large  Scale  Targeted  Programme  that 
will  enable  Europe  to  play  a  prominent  role  as  a  solutions'  provider  on  the  world  stage. 

Ei^  is  as  open  as  possible  widiout  sacrificing  the  overall  goals  and  momentum  of  die  initiative. 
The  woridng  groiqis  in  Ei^  are: 

i)  Ei^  working  groi^i  on  ^iplications; 
i)  Ei^  working  groi^  on  software  architecture; 

iii)  Ei^  working  group  on  hardware  and  architectures; 

iv)  Ei^  working  group  on  algorithms  and  methods. 

The  Physics  and  Electronics  Laboratory  THO  [UDticipates  in  the  European  Industry  Initiative  Ei^. 

3.5  Information  Technology  ,  Telecommunication  and  Telematics  Initiative 

In  recognition  of  the  increasingly  important  role  Information  Technology  ,  Telecommunication 
and  Telematics  (TT&T)  are  playing  in  modem  society,  TNO's  management  has  decided  to  launch 
a  major  new  IT&T  initiative.  This  initiative  is  intended  to  make  TNO's  broad  range  of  FT&T  skills 
and  expertise  more  accessible  to  potential  clients.  Not  only  is  TNO  anxious  to  foster  greater 
synergy  in  IT&T  developments,  but  it  is  also  keen  to  extend  the  scope  of  such  activities. 

TNO  has  identified  nine  areas,  which  are  already  part  of  its  core  business,  that  intends  to  target  in 
its  new  IT&T  initiative.  These  include  ; 

i)  Virtual  Reality; 

ii)  I^ocess  Control; 

iii)  Product  Data  Exchange; 

iv)  Document  Information  Systems; 

v)  Traffic  and  Transport; 

vi)  Training  and  Simulation; 

vii)  Hi^  Perfbriiiaiice  Coinputing; 

viii)  Human  Factors  Engineering; 

ix)  Signal  Processing. 

In  develt^ing  and  q>plying  IT&T  technologies  in  the  nine  target  areas,  TNO  will  continue  to 
utilize  its  wide  pool  of  knowledge  and  expertise  in  related  fields  such  as  materials  science. 
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structural  engineeriiig,  applied  physics  and  process  technology  (excerpt  fiom  TNO  Newsletter 
Applied  Research,  April  1993). 

3.6  TNO-FEL  High  Performance  Qxnputing 

TNOFEL  High  Performance  ConqMiting  (HPC)  is  a  centre  of  eiqxztise  for  informatiCMi 
technology  fully  e]q>loiting  HPC.  TNO-FEL  provides  research,  development,  engineering  and 
consultancy  sovices  to  governments  and  industries.  Clients  are  assisted  in  solving  conq>lex 
problems  and  challenging  technical  problems  and  technological  iimovation.  TNO-FEL  regards 
HPC  technology  as  an  area  of  strategic  inqxntance.  Currently,  to  develop  leading  edge 
technology,  TNO-FEL  actively  participates  in  national  and  international  Research  and 
Technology  Progratmnes  (ESPRIT,  EUCLID). 

TNO-FEL  has  invested  significantly  in  applying  HPC  in  2-D  and  3-D  (medical)  Computer 
Vision,  3-D  real-time  simulation  and  visualisation  (image  generation  and  virtual  environments), 
image  reconstruction  and  signal  processing  and  has  now  obtained  an  internationally  recognised 
position  in  these  fields.  TNO-FEL  has  initiated  both  a  National  and  a  Eur(q)ean  Industrial 
Initiative  for  High  Performance  Computing.  HPC  at  TNO-FEL  includes  hardware  and  software 
technology  and  system  i^lications  development  towards  quality  standards  like  ISO  9000.  TNO- 
FEL  has  developed  (hardware  and  software)  a  multi-processor,  scalable  and  configurable 
architecture  (currently  with  24  i860  processors)  widi  dual  communication  channel.^ 
(>l(X)MBytes/s  each)  for  image  generation  and  voxel  data  visualisation.  For  image  generation, 
image  processing  and  visualisaticm  purposes,  TNO-FEL  uses  also  four  tran^uter-based  systems 
with  6,  10  and  2x21  T80S-processots  and  a  communication  channel  with  120MBytes/s  csq>acity, 
and  also  a  scalable,  electronically  configurable  transputer-based  multicluster  (64  times  T80S)  with 
graphics  boards.  For  visualisations  widi  real-time  virtual  reality  (VR)  performance  TNO-FEL 
uses  a  hybrid  system  widi  both  T80S  transputers  and  i860  processors  with  advanced  VR-hehnet 
and  ctmtrol  devices.  (All  T80S  tran^uters  will  be  rqilaced  by  T9(XX)  tran^uters  as  soon  as  this 
processor  becomes  available.)  TNO-FEL  has  initiated  a  European  project  for  the  industrial 
development  of  a  training  and  simulation  system  for  Minimal  Access  Surgery,  and  is  working  on 
a  national  industrial  HPC  utilisation  initiative  for  Medical  Radiation  Applications. 
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4  COMPUTER  SYSTEMS  ORGANISATION 

This  cluster  contains  an  introductory  overview  of  the  organisation  of  conqmter  systems  which 
may  be  i^lied  to  HIPMPS.  It  does  by  no  intent  to  define  the  hardware  configuration  of 
HIPMPS. 

4.1  System  architectures 

A  computer  system  can  be  constructed  with  the  use  of  modules,  including: 

i)  host  computer; 

ii)  control  processors; 

iii)  grafritics  processor; 

iv)  frame  grabber; 

v)  transputers. 

The  host  computer  is  the  main  computing  module  in  the  architecture.  It  may  be  a  Personal 
Computer  (PC)  system,  advanced  workstation,  mini  or  main  fiame  computer,  and  it  hosts  the 
operating  system. 

A  control  processor,  or  controller  in  short,  s^vices  the  interface  between  the  host  con:q>uter  and  a 
peripheral  device.  When  a  topology  network  of  transputers  is  connected  to  the  host  computer  for 
additional  computing  power,  a  controller  is  used  to  give  the  transputer  network  slave  instructions. 
The  network  informs  the  controller  about  its  status  and  the  status  of  the  ta.sk  that  has  been 
performed.  There  is  also  a  controller  required  to  interface  with  the  graphics  processor. 

A  gitqihics  processor  is  an  additicKial,  dedicated  processor  for  graphics  purposes.  It  accepts 
commands  from  the  (gnqihics)  controller.  Usually,  a  grtqihics  processor  is  added  as  a  server, 
inqilying  that  it  continuously  expects  input  from  the  controller. 

A  frame  grabber,  with  corresponding  controller,  is  usually  equqiped  with  video  memory  and 
allows  ftn:  the  digitisation  of  a  video  signal  (analog-to-digital  conversion).  There  are  a  lot  of 
different  types  available,  ranging  from  simple  grabbing  boards  to  multi-colour  overlay  grabbing 
and  display  boards. 

There  are  various  types  of  transputers  available,  differing  in  the  amount  of  'on-board'  memory,  the 
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number  of  ii^t-ou^put  links  and  tbe  number  of  bits  dte  floating  point  processor. 

Depending  <»  die  cmnputational  task  to  be  petfmmed,  a  computa  arcfaitectuie  can  be  composed 
such  diat  die  (peifonnance)  lequiremeiits  can  be  satisfied.  To  decide  on  the  architecture,  a  system 
qiecification  methodology  can  be  followed. 

4.2  System  specification  methodologies 

A  hard-  and  software  system  can  be  designed  following  a  structured  design  methodology. 
Thereto,  functional  black  boxes  are  defined  v^iich  are  connected  to  obtain  a  hierarchical, 
functUMial  system.  The  interconnections  are  idtributed  with  data  and  control  streams.  A  graphic 
display  of  the  black  boxes  and  intercoimections  is  called  a  structure  chart,  and  hence  shows  die 
organisation  of  the  cooqilete  system.  The  structure  chart  serves  as  a  qiecification  for  system 
inqilementators  and  can  be  used  to  gauge  the  functicmality  and  quality  of  the  system. 

Modules  are  ^lecified  by  a  descr^on,  for  software  systems  called  a  pseudo  code,  including  i) 
the  module  name;  ii)  its  purpose;  iii)  the  modules  it  uses;  iv)  its  input/ouqmt  qiecifications  and  v) 
a  list  of  functional  details,  including  error  handling. 

An  interconnection  is  a  measure  of  the  interdependence  between  two  modules.  There  should  be  a 
mifiimiim  of  intercoimections  by  eliminatioD  of  unnecessary  relationshqis  between  modules, 
reduction  of  die  number  of  required  crmnections  and  easing  the  tightness  of  necessary 
relationships.  There  exist  three  types  of  into’coimections:  i)  connection  by  parameters,  ii) 
coimection  by  a  globally  accessible  data  area  and  iii)  coimection  by  directly  coimecting  the 
internals  of  modules. 

A  structured  qiecification  diould  consist  of  i)  a  data  flow  diagram;  ii)  a  data  dictionary;  iii)  state- 
transition  diagrams,  iv)  decision  trees;  v)  decision  tables  and  vi)  an  informational  model.  Page- 
Jones  (1988)  describes  diese  items  as  follows. 

A  structured  data  flow  diagram  shows  die  active  conqxments  of  die  system  and  the  data  interfaces 
between  dmn.  &  is  used  to  partition  a  system  while  the  systnn's  structuredness,  desired  qualities, 
conciseness  and  degree  of  partitioning  can  be  concluded  from  this  diagram. 


A  structured  data  dictionary  is  an  analysis  tool  that  primarily  records  the  information  content  of 
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and  includes  pi^sical  fannat  of  data  only  as  an  addendum.  It  contains  die  definition 
of  all  mentioned  in  all  diagrams. 

A  state-transition  diagram  shows  the  various  states  of  a  system  and  the  relationsh^s  between 
diese  states.  Decision  making  is  the  basis  of  transitiiming  from  one  state  to  another. 

A  decision  tree  and  decision  table  eiqilicitly  show  die  decision  making  process. 

The  qiecification  process  must  be  verified  using  structured  walkthroughs.  Guidelines  dierefore 
can  be  found  in  Page-Jones  (1988)  and  Yourdon  (1986). 

Recendy,  object-orented  analysis  and  design  methodologies  became  in  fashion.  A  conqiarison  of 
techniques  and  critiques  can  be  found  in  Fichman  and  Kemerer  (1992). 

4.3  Single  data  stream  architectures 

A  single  data  stream  architecture  allows  for  die  sequential  processing  of  data  according  to  the 
program  code  or  the  user  instructions. 

4.4  Mult^le  data  stream  architectures 

Duncan  (1S190)  is  one  of  the  many  authors,  who  diaringiiiKh  parallel  architectures,  vector 
processors,  SIMD  architectures,  processor  arrays,  associative  memory  processor  architectures, 
systolic  architectures  and  wave  front  architectures.  He  describes  them  as  follows. 

Parallel  architectures  are  high-level  framewoiks  for  the  development  of  parallel  programming 
solutions  by  providing  mult^le  processors,  ^i^dier  single  or  conqilex,  that  cooperate  to  solve 
problems  tliroogli  concurrent  execution. 

Vector  processor  architectures  are  characterised  by  mult^le,  pqielined  functional  units,  which 
implemgnt  arithmic  and  Boolean  operations  for  both  vectors  and  scalars  and  which  operate 
concurrently  (synchronous  architecture). 

SIMD  architectures  consist  of  a  central  control  unit,  multqile  processors  with  local  memory,  and 
an  intacoimection  network  for  eitha  processor-to-processor  or  processor-to-memory 
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communications . 

MIMD  architectures  employ  multq)le  processors  that  can  execute  independent  instruction  streams 
using  local  data:  they  support  parallel  solutions  that  require  processors  to  operate  in  a  largely 
autonomous  fashion  (asynchronous  conqtuters,  characterised  by  decentralised  hardware  control). 
Basically,  there  exist  4  topologies: 

i)  ring  topologies:  most  appropriate  for  a  small  number  of  processors  executing  algorithms  not 
dominated  by  data  communications; 

ii)  mesh  topologies:  each  of  the  communication  lines  is  connected  to  its  4  immediate 
neighbours  (also  called  lattice  topology); 

iii)  tree  topology  architectures:  constructed  to  support  divide-and-conquer  algorithms  for 
searching  and  sorting,  image  processing  algorithms,  and  data  flow  reduction  programming 
iq)plications; 

iv)  hypercube  topology:  most  iq>propriate  for  developing  "scalable"  architectures  that  support 
the  performance  requirements  of  3-D  scientific  applications. 

These  SIMD  architectures  can  be  configured  by  programmable  switches  that  allow  users  to  select 
a  logical  topology  matching  {q)plication  communication  patterns. 

Processor  array  architectures  ate  useful  for  large  scale  scientific  calculations,  such  as  image 
processing  when  structured  for  niunerical  SIMD  execution. 

Associative  memory  processor  architectures  arc  distinctive  types  of  SIMD  architecture  that  use 
special  comparison  logic  to  access  stored  data  in  parallel  according  to  its  contents.  A  program 
controller,  usually  a  serial  coiqmter,  reads  and  executes  instructions,  invoking  a  specialised  array 
controller  when  associative  memoiy  instructions  are  encountered.  Special  registers  enable  the 
program  controller  and  associative  memory  to  share  data. 

Systolic  architectures,  or  systolic  arrays,  are  pq)elined  multq>rDcessors  in  which  data  is  pulsed  in 
fitythmic  fashion  (synchronous  control)  from  memory  and  through  a  netwoik  of  processors  before 
returning  to  memory. 

Wave  front  architectures  make  use  of  asynchronous  control,  while  data  are  transported  through 
the  iMtworking,  evoking  processes  at  their  arrival. 


TNOraport 


Fige 

33 


4.5  On^niter-communicadcMi  netw(»ks 

Distributed  conqniting  is  die  loosest  fonn  of  parallelism,  in  which  parts  of  a  problem  are  divided 
among  various  nodes  and  there  is  relatively  little  communicatkm  once  processing  begins. 

A  communication  mediod  is  like  packet-switching:  every  processor  in  die  system  has  an  address, 
and  routing  infonnatum  in  a  message  guides  it  through  die  netwoik,  sometimes  through 
intervening  processors,  to  its  destination.  Generally,  die  routing  of  messages  is  explicitly  worked 
out  by  the  programmer,  possibly  widi  the  assistance  of  various  software  tools,  as  die  program  is 
written.  Message  passing  is  the  most  popular  programming  model  for  massively  parallel 
processors  (Zorpette  (1992)). 

4.6  System  maintenance 


Mutatis  mutandis  Section  5.5:  System  maintenance. 
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5  SOFTWARE  SYSTEM  ORGANISATION 

A  software  system  is  defined  as  die  integration  of  software  code  which  runs  on  the  hardware 
system.  The  organisatioo  of  diis  software  system  may  be  depeodait  or  to  a  certain  level 
indqieiident  of  die  hardware  system.  Therefore,  all  diat  qiplies  to  die  system  qiecification 
mediodologies  (Section  4.2)  qiplies  to  the  software  system  organisation.  In  diis  cluqiter 
programming  techniques  and  software  engineering  techniques  are  discussed.  these 

techniques  a  software  system  can  be  defined.  Next,  programming  languages  and  operating 
systems  are  discussed. 

5.1  Programining  techniques 

ftogramming  techniques  can  be  distinguished  into  three  catagories: 

i)  process-oriented  progratnming; 

ii)  object-based  programining: 

iii)  object-oriented  programmmg. 

Process-orientated  programming  allows  for  the  design  of  systems  in  which  the  focus  is  on  a 
process  to  be  modeled.  This  has  been  the  traditional  technique  to  programming  tqi  to  the  early 
1980's. 

Object-oriented  programming  aims  at  infonnaticai  hiding,  abstraction,  dynamic  binding  and 
inheritance  of  object  features  (Bihari  and  Gopinath  (1992)  and  Rine  and  Bhargava  (1992)). 

Object-based  programming  is  like  object-orieoted  programming,  with  the  excqidon  that  it  does 
not  siqiport  inheritance.  It  does  siqiport  data  and  program  abstraction,  generic  types  and  operator 
overloading. 

5.2  Software  engineering 

See  Section  4.2:  System  specification  mediodologies,  especially  qipUed  to  software  systems. 

5.3  nogramming  languages 

A  parallel  programming  language  can  provide  different  levels  of  (hardware)  architecture 
indepoidence,  depending  on  how  much  of  die  underlying  architecture  is  hiddm  fmn  die 


programmer.  There  5  main  levels  at  which  indq>endeDce  can  be  enfoiced  (Webb  (1992)): 

i)  die  processor  architecture; 

ii)  the  amy  size; 

iii)  die  any  topology; 

iv)  the  inteiprocessor  ctmununication; 

v)  the  process  management. 

Process-oriented  programming  languages. 

Software  code  ninning  on  MIMD  aichitectures  may  be  inqilenmited  in  any  programming 
language  (Pascal,  C,  Fbitran,  etc.).  However,  these  programming  languages  do  not  facilitate 
communicational  aids.  A  programming  language  widi  the  ability  to  have  control  over  the 
communication  is  OCCAM  2  (Hoare  (1988)).  OCCAM  siqiplies  die  highest  possible 
performance,  but  is  not  easily  ported  to  other  computer  configurations.  The  C-programming 
language,  however,  makes  porting  of  code  more  easy.  Besides,  the  C-programming  language  is 
more  or  less  accepted  as  an  industry  standard  fot  programming. 

Object-oriented  programming  languages 

Recendy,  programming  langueges  became  available  that  siqiport  the  object-oriented 
programming  concept  These  languages  include : 

i)  FLEX  (Kenny  and  Lin  (1991)); 

ii)  RTC-h-  (Ishikawa  et  aL  (1992)); 

iii)  RIPE  (MiUer  and  Lennox  (1988)); 

iv)  CHAOS  (Schwan  et  aL  (1987)). 

’Older’  languages  are,  e.g.,  Smalltalk  80  and  C-H-.  In  the  object-oriented  model,  the  entire  wrn-ld  is 
nrade  up  of  two  types  of  entities:  objects  and  messages.  TAfith  diis  model  the  understandabiUty, 
adqitability  and  code  reusability  are  increased,  while  it  carries  properties  like  information  hiding, 
abstraction,  dynamic  binding  and  inheritance  of  object  features  (Bihari  and  Gopinath  (1992)  and 
Rise  and  Bhargava  (1992)). 

Objects  include  bodi  software  and  physical  enddes.  Software  objects  enc^isulate  data  and 
provide  units  of  code  called  methods  for  accessing  data.  Each  object  is  assigned  a  unique  name 
for  idendficadon  purposes:  other  objects  can  address  it  with  this  name.  Objects  communicate  by 
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aeoding  and  receiving  messages. 

Messages  are  addressed  to  the  receiving  object  and  contains  die  name  of  a  specific  method  of  die 
recieving  object  diat  is  to  be  executed,  along  widi  parameters  such  as  names  of  odier  objects.  An 
object  can  manipulate  anodwr  object's  encapsulated  data  using  the  message. 


5.4  Operating  Systems 

HELIOS  has  lecendy  been  developed  and  becomes  (more  or  less)  accepted  as  an  industry 
standard  Operating  System  (OS)  for  transputer  networics.  HELIOS  provides  a  UNDC-like  'look 
and  feel'  programming  environment  for  die  C-programming  language.  It  runs  on  both  Personal 
Con^ter  systems  and  UNIX-based  workstations.  An  excellent  git^hics  output  and  a  menu- 
controlled  user-interface  can  be  provided  via  calls  to  the  HELIOS-supported  X-window  library. 


S.S  System  maintenance 

Maintenance  is  usually  a  part  of  the  software  life  cycle  delegated  to  low-level  programmers. 
Planning  for  maintenance  should  take  place  concurrendy  with  development.  A  standard  fos 
software  maintenance  will  provide  powerful  help  to  those  who  prefer  to  keep  large  and 
col]:^>licated  software  systons  tqierational  irrespective  of  dieir  age.  The  TKP.F.  P1219  Working 
Groups  is  creating  such  a  standard  to  address  the  jsoblem  of  software  maintenance  that  faces  all 
corporations.  This  standard  is  expected  to  be  adopted  early  1993  (Vera-Edelstein  and  Mamone 
(1992)). 


3  Comcl  pcnou:  D.  Vam  Eddarin  aid  SahraMt  Mamooe,  NYNEX  Sdenoe  and  Tedmoiogy  Inc.,  300  WeaKhaiier  Avenne,  WUie  Plaint, 
NY  10604,  USA. 
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6  DATA 

6.1  Image  fonnats 

The  American  College  of  Radiology  (ACR)  and  the  Nariooal  Electrical  ManiifKtiiiers 
Association  (NEMA)  prepared  image  foroMts  and  data  comnmnicatioo  fonnats  (ACR/NEMA 
(1988)).  These  standards  are  moR  <»  less  accepted  by  a  large  number  of  si^liers  of  medical 
imaging  systems  (Hetfortfa  et  al.  (1989)).  Consequently,  Aese  standards  should  be  foUowed.  For 
diis  standard  and  other  ones,  see  de  Moor  et  al.  (1993). 

6.2  Data  conqiaction  and  compression 

Data  conqMkcdon  and  data  con^iression  aim  at  obtaining  an  efficient  representation  of  (image) 
Hara  for  strorage  and  transmission  purposes.  There  are  two  types  of  conqiression  techniques: 

i)  irreversible  (lossy,  noisy  or  information  reducing  conqsession); 

ii)  reversible  (lossless,  error  firee  or  information  preserving  cotninessi(»). 

Highest  data  reduction  is  obtained  with  irreversible  conqnessirm  at  the  costs  of  loosing  data.  Due 
to  legal  aspects  in  medical  imaging,  irreversible  data  ccmpression  is  not  in  aU  countries  allowed. 
In  some  qiplicatirms  reversible  data  cotrqitession  is  prefered  over  irreversible  compression  since 
errors  may  be  enhanced  during  image  post  processing. 

Data  crmqffession  algorithms  can  be  characterised  by: 

i)  bit  rate; 

ii)  encoding/decoding  time; 

iii)  robusmess. 

Roos  (1991)  concluded  for  reversible  intraframe  conqnessirRt,  that  the  Laplacian  Pyramid,  Walsh- 
Hadamatd  Transform,  Sequential  Transform,  Discrete  Cosine  Transform  and  Subband  Coding  are 
inferior  techniques  compared  widi  (Ad^>tive)  P3aiamic  Pulse  Code  Cotrelatimi  and  the 
Hierarchical  Decorrelation  Method  based  on  interpolation.  According  to  Roos,  die  last  technique 
has  die  best  performance,  it  is  simple,  it  does  not  use  parameters  and  has  a  low  sensitivity  to  noise 
and  channel  etrore. 

For  reversible  maHioal  image  conqnession,  Roos  (1991)  crnicluded  diat  both  the  Huffinaim  and 


die  eridimic  coding  ou^xrfonn  tbe  Leoqiel-Ziv  coding.  Model-baaed  static  Huffinann  coding 
peifonns  optimally  for  bodi  8-bit  and  12-bit  radiological  and  nuclear  images.  An  efficient 
hierarchical  mediod  for  reversible  image  cooqvession  is  described  by  Viergever  and  Roos  (1993). 


TNO  report 


f 


Page 

39 


7  DATABASE  MANAGEMENT 

Mass  data  handling  and  data  storage  require  advanced  database  management  systems.  Here,  we 
distinguish  a  medical  image  database  system  (Section  7.1)  from  a  logical  database  system 
(Section  7.2).  The  first  is  used  for  images,  the  latter  for  image  objects  and  object  features. 

7. 1  Medical  Image  Database  System 

Database  management  supports  the  storage,  retrieval,  presentation  and  inteipretadon  of  medical 
images.  The  medical  image  database  system  can  be  linked  to  the  logical  database  system,  as  has 
been  demonstrated  by  Orphanoudalds  et  al.  (1989). 

7.2  Logical  Database  System 

A  logical  database  system  supports  image  feature  extraction,  image  content  representation  and 
organisation  of  stored  information,  search  and  retrieval  strategies  and  user  interfaces.  To  date,  a 
general  methodology  for  the  design  of  databases  has  not  been  developed.  There  are  many 
concepts  for  databases.  To  allow  data  representations  at  various  levels  of  abstraction,  the 
concepts  of  multidatabases  may  deliver  prospects.  These  include  (Bright  et  al.  (1992)): 

i)  distributed  databases; 

>i)  global  schema  databases; 

iii)  federated  databases; 

iv)  multidatabase  language  systems; 

v)  homogeneous  multidatabase  language  system; 

vi)  interoperable  systems. 

Each  multidatabase  concept  has  its  novelties  in  issues  like: 

i)  site  autonomy; 

ii)  data  representation  (names,  formats,  structures,  conflicts,  missing  data); 

iii)  contraints; 

iv)  processing; 

v)  concurrency  control  and  vi)  security. 
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8  IMAGE  PROCESSING  TECHNIQUES 

This  cbi^ter  contains  various  aspects  of  image  processing  techniques.  We  do  not  aim  at 
completeness  but  at  presenting  a  concise  overview. 

8.1  Digitisation 

When  an  image  is  to  be  processed  by  a  con:q>uter,  it  is  often  described  as  a  matrix,  or  some  other 
data  structure.  This  conversion  requires  3  steps: 

i)  scanning,; 

ii)  sanq>ling; 

iii)  quantitizadon. 

Scanning  is  the  process  to  acquire  a  signal  from  a  sensor  which  is  to  form  an  image  of  a  scene  in  a 
general  sense. 

Sampling  is  required  in  order  to  convert  the  signal  into  a  finite  set  of  numbers;  sampling  is  the 
selection  of  a  set  of  discrete  points  in  the  continuum  of  time  and  space.  Only  the  values  of  the 
signal  at  those  points  will  be  used  for  further  processing.  The  sampling  frequency  must  satisfy 
Shannon's  sampling  theorem  (e.g.,  Pavlidis  (1982))  to  guarantee  that  the  signal  can  be 
reconstructed  from  the  finite  set  of  sanq)ies.  However,  there  is  often  a  need  to  oversampling, 
depending  on  the  reconstruction  algorithm  used.  If  the  sampling  interval  does  not  satisfy 
Shannon's  san:q>ling  theorem,  then  a  distortion  of  the  signal  spectrum  occurs  that  is  known  as 
aliasing:  a  high  frequency  signal  appears  as  a  low  frequency  signal  after  sampling  at  too  low  a 
rate. 

Quantitization  is  the  process  of  representing  the  signal  values  by  a  finite  number  of  bits,  and  can 
be  considered  to  be  a  mapping  from  real  numbers  into  a  range  of  integers.  Since  the  amount  of 
bits  is  often  insufficient  to  represent  the  real  numbers,  the  differences  appear  as  quantitization 
noise. 

The  process  of  scarming,  sarrpling  and  quantitization  is  referred  to  as  digitisation. 
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8.2  Enhancement 

Image  data  often  need  enhancement  of  characteristics  and  correction  for  distortions  introduced 
during  the  itnaging  process.  Examples  of  image  enhancement  techniques  are; 

i)  grayscale  manqnilation  (stretching); 

ii)  histogram  equalisation  (contrast  enhancement); 

iii)  sharpening  (edge  enhancement); 

iv)  smoothing  (blurring). 

Advanced  image  filtering  techniques  are  available  to  accomplish  image  enhancement. 

8.3  Restoration 

Images  are  produced  in  order  to  record  or  display  useful  information.  Due  to  imperfections  in  the 
image  formation  process  (a  nonlinear  modulation  transfer  function  (MTF)  of  the  imaging  chain), 
however,  the  recorded  images  often  represent  a  degraded  version  of  the  original  scene.  Although 
the  degradations  may  have  many  causes,  two  types  of  degradation  are  usually  dominant:  blurring 
and  noise.  The  field  of  image  identification  and  restoration  is  concerned  with  the  problem  of 
undoing  the  effects  of  inperfections  in  the  image  formation  process  in  order  to  facilitate  the 
(human)  interpretation  or  further  processing  (e.g.,  analysis)  of  the  recorded  images.  More 
specifically,  the  goal  of  image  identification  is  to  estimate  the  properties  of  the  inperfect  imaging 
system  (blur)  from  the  observed  degraded  image,  together  with  some  (statistical)  characteristics  of 
the  noise  and  the  original  (uncorrupted)  image.  On  the  basis  of  these  properties,  the  image 
restoration  process  computes  an  estimate  of  the  original  image  (Lagendijk  (1990)).  In  medicine, 
these  techniques  can  be  pplied  to  reduce  cardiac  and  repiratory  nmtion  artefacts  in  image  data 
(e.g.,  Atalar  and  Onural  (1991)). 

The  correction  for  distortions  introduced  by  the  imaging  system  is  often  necessary,  especially 
when  object  features  are  to  be  extracted  from  the  image  data.  Image  distortion  can  be  removed 
with  available  techniques  in  the  field  of  stochastic  restoration,  including  Bayesian  methods, 
Wiener  filtering  and  Kalman  filtering,  the  field  of  algebraic  restoration  and  iterative  methods 
(Lagendijk  (1990),  Lim  (1990),  Kaufinan  and  Tekalp  (1991)). 


Image  enhancement  and  image  restoration  are  the  first  step  in  image  analysis. 
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Image  leconstnictioo  is  directed  towards  the  (ie-)construction  of,  usoally  cross-sectional,  images 
from  projection  data  (Dumay  (1992)).  Algoridims  for  reconstruction  from  emission,  transmission 
and  reflection  data  are  widely  available  (Herman  (1980),  Kak  and  Slaney  (1987),  Natterer 
(1986)).  Recently,  advanced  iterative  algorithms  in  die  field  of  image  reconstructicm  became 
available  (van  Dijke  (1992)),  including  statistical  approaches  (e.g.,  Liang  et  al.  (1989)),  Ollinger 
(1990)). 

8.5  Segmentation 

The  segmentation  of  an  image  into  single  objects  and  their  mutual  relationsh^  is  the  second  step 
in  image  analysis.  Image  segmentation  is  directed  towards  edge  detection  and  partitioning  the 
image  into  legicms  which  are  homogeneous  according  to  some  predefined  criteria.  The  success  of 
an  image  segmentation  procedure  can  usoally  only  be  evaluated  at  a  higher  level  of  data 
abstraction. 

There  are  roughly  three  types  of  image  segmentation  approaches: 

i)  segmentation  by  filtering  and  thresholding  (Sahoo  et  al.  (1988),  Zhang  and  Gerbrands 
(1992)); 

ii)  rule-based  image  segmentation  (Levine  and  Nazif  (1985),  Smets  (1990)); 

iii)  enqiloying  pyramidal  structures  (Tanimoto  (1983))  and  hyperstacks  (Jackway  (1992)). 

These  techniques  can  be  qrplied  to  various  types  of  images,  though  dedicated  techniques  are 
available  for  segmenting  noisy  images  (Gerbrands  (1988),  Dumay  et  aL  (1991)).  De  Graaf  et  al. 
(1992)  elaborated  on  a  method  to  evaluate  die  success  of  image  segmentation  methods. 

8.6  Feature  extraction 

Extraction  of  features  like  invariance,  rrumients,  projections,  size  and  diqie,  and  texture  follows 
the  segmentation  leveL  At  present,  a  large  number  of  techniques  are  available  (Sinxin  (1988)), 
including  tiiose  making  use  of  parallel  conqniting  techniques  (Buikbardt  et  al.  (1990)).  Recently, 
Salden  et  aL  (1992)  presented  a  new  mediod  of  multi-resolution  image  analysis  diat  gives  the 
most  concise  set  of  local  orthogonal  invariant  features  of  2-dimensional  irq>ut  images.  Reiss 
(1992)  used  tensors  to  generate  algebraic  invariance  in  2-D  and  3-D  images,  and  showed  diat 
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these  features  are  much  more  robust  than  afiine  invariant  Fourier  descriptors. 

8.7  Scene  analysis 

Image  understanding  by  computer  techniqttts  is  a  process  which  proceeds  from  raw  digital 
images  to  a  symbolic  description  of  the  contents  of  the  image  scene.  Essentially,  image 
understanding  by  counter  can  be  considered  as  the  extraction  of  meaningful  entities  or  the 
confiimatitHi  of  the  absence  of  some  meaningful  entities  within  the  given  image(s),  as  well  as 
giving  a  description  of  their  interrelationships  in  the  context  of  the  original  scene,  which  is 
represented  by  the  image(s).  Scene  analysis  is  the  final  stage  of  an  image  understanding  system 
and  can  be  found  at  the  highest  level  of  abstraction.  At  this  level,  domain  knowledge  must  be 
included  (e.g.,  Cheng  (1990)). 

8.8  Data  fusionAegistration 

Data  fusion,  or  registration,  concerns  the  matchting  of  data  colected  from  different  scanning 
systems.  It  involves  transformations  to  map  one  image  reference  system  onto  another  system.  Van 
den  Elsen  et  al.  (1993)  distinguish  two  types  of  methods,  i.e.,  intrinsic  and  extrinsic 
transformation  methods.  Intrinsic  methods  make  use  of  patient-related  properties  (pixel  or  voxel 
values,  anatomical  landmark  points,  geometrical  features,  administered  constrast  dye,  etc.),  while 
extrinic  methods  make  use  of,  e.g.,  head-mounted  frames  or  skin  markers. 
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9  PATTERN  RECOGNITION 

This  cluqMer  contains  an  introductory  and  definitely  incomplete  overview  of  topics  related  to 
pattern  recognition.  Pattern  recognition  can  be  carried  out  by  eidter  classification  of  samples  on 
the  basis  of  saii^>le  features  (siqwrvised)  or  clustering  of  san^les  on  the  basis  of  a  (unsupervised) 
groiqnng  criterion. 

9.1  Decision  models 

At  present,  there  are  some  distinct  decision  models  known,  including  the  Bayesian  decision 
theory.  Bayesian  decision  theory  is  a  fundamental  statistical  approach  to  the  problem  of  patter 
classification.  This  approach  is  based  on  the  assunqrion  that  the  decision  problem  is  posed  in 
probabilistic  terms,  and  diat  all  the  relevant  probability  values  are  known  (Duda  and  Hart  (1973)). 

The  disadvantage  of  siq)ervised  mediods  is  the  need  for  die  generation  of  training  sets  and  the 
associated  human  interaction  and  that  of  the  unsupervised  methods  is  its  ignorance  of  the 
relationsh^s  between  different  objects  and  a  tendency  to  generate  too  many  clusters  or  groupings 
which  can  be  misleading. 

Advanced  models  in  the  field  of  fuzzy  set  theory  are  available  (Pal  and  Dutta  Majumder  (1987)), 
while  pattern  recognition  by  enqiloying  artificial  neural  networks  is  described  in  some  more  detail 
in  Section  3.3. 

9.2  Design  methodology 

Classifier  design  and  evaluation,  feature  evaluation  and  selection,  and  pattern  analysis  ate  needed 
in  die  eiqilatatory  data  analysis.  Design  methodologies  can  be  found  in  text-  and  handbooks  (e.g., 
Duda  and  Hart  (1973)). 

9.3  Clustering  techniques 

The  design  and  evaluation  of  clustering  or  groiqiing  tmrhniqii^  is  described  in  textbooks  like 
Coo^  and  Lohnes  (1971),  Fkikunaga  (1972),  Anderberg  (1973),  CUfford  and  Ste|dieiison  (1975), 
Hartigan  (1975),  Everitt  (1978)  and  Dubes  and  Jain  (1981). 
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10  ANALYSIS  OF  ALGORITHMS  AND  COMPLEXITY 

Image  Enhancement 

Perona  and  Malik  (1987)  and  Gerig  et  aL  (1992)  described  ninlinear  anisotropic  filtering  of  MRI 
in  scale  ^>ace  and  claim  diat  object  contours,  boundaries  between  different  tissues  and  small 
structures  such  as  vessels  are  not  only  preserved,  but  even  enhanced:  the  filtered  images  qjpeared 
clearer  and  boundaries  were  much  better  defined,  leading  to  an  inqiroved  differentiation  of 
adjacent  regitnis  of  similar  intensity  characteristics.  The  algorithm  is  suitable  for  parallel 
iixq>lementation. 

Image  Segmentation 

Amartur  et  al.  (1992)  described  a  preliminary  study  to  segment  multicontrast  MR  images  with  the 
use  of  a  Hopfield  neural  network.  They  i^lied  a  modification  to  the  energy  function  suggested 
by  Hopfield  (1982)  and  proved  its  correctoess.  The  objective  was  to  assign  N  pixels  of  P  features 
to  M  classes  such  that  the  assignment  of  the  pixels  minimises  a  criterion  function  for  which  a 
metric  measure  between  a  pixel  and  a  class  or  a  ncmsimilnrity  measure  between  a  pixel  and  die 
other  classes  was  chosen.  The  neural  architecture  consisted  of  a  grid  of  NxM  neurons  with  each 
column  representing  a  class  and  each  row  representing  a  pixel.  The  system  inputs  are  initialiwt  to 
random  values  (mean  0,  standard  deviation  about  mean  0.1)  The  network  was  said  to  have 
reached  convergence  if  all  neurons  have  negligible  input-output  activity.  Good  results  were 
obtained  fixim  T2-weighted  and  proton  density-weighted  images:  a  good  differentiatioo  between 
the  gray  and  white  matter  was  achieved.  This  work  is  in  progress. 

Soltanian-Zadeh  et  al.  (1992)  evaluated  the  performance  of  several  filters  tqiplied  to  MRI  scene 
sequences  for  image  enhancement  and  segmentation.  They  compared  die  signal-to-noise  ration, 
contrast-to-noise  ratio,  segnoentation  of  a  desired  feature  and  the  correction  for  the  partial  volume 
effect  from  the  various  filters.  They  concluded  diat  the  eigenimage  filter  (Sohanian-T^adeh  et  al. 
(1990))  performed  best  with  reflect  to  die  segmentation  of  a  desired  feature  and  the  correction  to 
die  partial  volume  effect 

Choi  et  al.  (1991)  introduced  a  statistical  image  model  which  allows  mixture  of  multqile  classes 
within  a  voxel.  This  model  seems  well-suited  for  medical  images  including  MRI,  in  which  many 


voxels  rqaesent  mixtures  of  multiple  tissues.  Siuce  tbe  mediod  dq)eiids  on  the  assumption  diat 
die  structures  of  interest  are  some^i^iat  larger  dian  single  pixels,  modifications  may  be  required  in 
order  to  accurately  estimate  the  extent  of  smaller  padiologic  lesums  in  the  brain,  such  as  small 
infarcts.  Iterative  reestimation  of  the  mean  of  each  class  ^ipeared  to  provide  a  moderate 
improvement  in  performance  at  little  additional  computational  cost  hxqxovements  in  accuracy 
would  be  eiqiected  to  result  from  increasing  die  number  of  measuronent  channels  and  relating 
die  assunqitioo  dun  widiin-clasa  variations  in  signal  intensity  are  negligible  in  comparison  to 
measurement  noise.  The  algoridim  is  inherently  parallel. 

2Ujdenbos  et  al.  (1992)  described  a  very  simple  technique  to  automatically  extract  die  intracranial 
cavity  on  transverse  MR  brain  images.  They  spoke  of  a  robust  algoridim,  though  die  contours 
were  automatically  detected  successfully  in  only  70%  of  76  slices  in  4  volumes.  With  user- 
interaction  the  success  rate  increased  to  91%.  The  limited  success  of  the  automatic  version  was 
attributed  to  die  partial  volume  effect,  which  blurred  die  tissue  transitions. 

Best  and  most  reliable  methods  for  image  segmentation  are  those  involving  multiscale  qiproaches 
(Choi  et  al.  (1991),  Ueda  and  Suzuki  (1993),  and  Mokhtarian  and  Mackwoith  (1986)). 

Data  Fusion 

Clarysse  et  al.  (1991)  described  the  mathematics  involved  with  frameless  matrhing  of  MRI  and 
X-ray  images  under  stereotactic  crmdidons.  Tbe  accuracy  and  precision  of  localisation  is  claimed 
to  be  sufficient  for  conqmter-assisted  interventions.  This  has  bem  demonstrated  on  24  patients. 

Visualisation 

Valentino  (1990)  and  Valentino  et  al.  (1991)  described  a  procedure  for  combining  and  visualising 
conylementary  structural  and  functional  information  from  MRI  and  PET.  Images  of  die  human 
brain  were  obtained  and  correlated  to  form  three-dimensional  volumes  of  image  data.  Volume 
rendering  and  solid-texturing  concepts  were  combined  to  develop  a  new  volume  imaging 
technique  for  "volume  texture-miqiping",  brain  glucose  metabolism  (from  FET)  onto  brain 
anatomy  (from  MRI).  A  consice  overview  of  visualisation  methods  can  be  found  in  Barillot 
(1993). 
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EVALUATION  AND  DEMONSTRATION 


11.1  Evahudoo  of  techniques 

Evaluatioo  of  developed  techniques  be  caoied  out  in  three  8tq>s: 

i)  computer-simulation  studies; 

ii)  realistic  phantom  studies; 

iii)  real  (patient)  studies. 

Conqwter-simulatimi  studies  are  required  in  order  to  implement  a  demonstrator.  Studies  based  on 
the  data  acquired  from  a  realistic  (patient)  model  (phantom)  are  necessary  to  demonstrate  die 
potential  of  HIPMPS  and  to  obtain  an  inqtression  of  the  sensitivity  (accuracy)  and  specificity 
<{Hecision)  of  the  system.  These  studies  are  also  necessary  to  prove  the  stability  of  the  system 
under  parameter  control.  Real  (patient)  studies  are  required  in  order  to  have  the  system  accepted 
in  the  field  of  medicine. 

11.2  Demonstration 

A  demonstration  system  consists  of  the  complete  hardware  configuration  and  the  conq>lete 
software  configuration,  qjplied  to  data  firtan  a  conqaiter-simulation,  realistic  jdumtom  study  and 
real  patient  study. 
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12  MANAGEMENT  OF  COMPUTING  AND  INFORMATION 

Tbe  management  task  force  and  resources  play  a  key  role  in  bringing  a  project  to  a  success.  In  this 
chapter,  some  of  the  goals  and  die  constraints  are  defined  and  techniques  to  reach  the  goals  within 
the  constraints  are  elaborated  iqxin. 

12.1  Project  management 

The  management  team  consists  of  the  line  management  (head  of  a  department),  division 
management  (section  head)  and  assignment  providers.  They  ^point  a  project  manager,  who  is 
given  the  responsibility  and  autheiisation  of: 

i)  the  complete  project  realisation,  including 

a  detailed  .system  analysis 
system  design 
system  development; 

ii)  milestone)  reporting  to  the  management  team; 

iii)  changes  in  the  project  realisation  strategy; 

iv)  financial  allocations  and  budget  control; 

v)  negotiating  in  conflicting  situations; 

vi)  project  controlling  to  siqiport  descision  making  by  the  management  team. 

In  agreement  with  the  project  manager,  the  management  team  assigns  personell  fiom  the  various 
disciplines,  departments  and  sections  to  the  project  (matrix  organisation). 

12.2  People  management 

Personell  assigned  to  a  project  work  together  with  the  project  manager.  The  people  are  carefully 
selected  by  the  management  team  in  collaboration  with  die  project  manager,  who  defines  the 
qualities  required.  The  project  manager  looks  afio-  qiprqmate  training  of  personell  whenever 
required. 

Each  person  assigned  to  a  project  reports  weekly  to  the  project  manager  on  i)  progress,  ii) 
problems  and  iii)  plans  for  the  next  week.  The  project  manager  and  tbe  assigned  persons  meet 
weekly  to  discuss  these  items  and  to  take  action  whorever  required.  These  discussions  should  take 
place  in  an  atmosphere  of  confidence  and  trust. 
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12.3  Installation  management 

The  detailed  system  analysis  results  in: 

i)  benchmark  definition, 

^i^iile  the  system  design  needs: 

ii)  conqniter  selection  and  configuration 

and  the  system  development  need: 

iii)  computer  equqntient  management: 

iv)  performance  and  usage  management. 

These  four  items  fix  the  limits  of  the  installation  management. 

12.4  Financial  management 

The  financial  management  covers  i)  pricing  and  ii)  resource  allocation.  A  priori  financial 
management  is  a  prime  responsibility  of  die  management  team.  In  the  course  of  the  project,  these 
tc^cs  of  financial  management  should  be  in  die  re^xmsibility  of  die  project  manager. 

12.5  Software  management 

In  collaboration  with  the  project  team  the  project  manager  decides  on: 

i)  the  software  develqnnait  methodology; 

ii)  software  maintenance; 

iii)  software  selection. 

In  general,  however,  constraints  must  be  satisfied.  These  include  die  policy  of  die  dqiartment  and 
die  user  requirements. 

A  software  development  mediodology  is  of  utmost  inqiortance  when  die  project  team  consists  of 
more  than  two  persms.  By  consequendy  following  one  single  methodology,  a  consistent  and 
well-documented  software  package  will  be  delivered. 

Software  maintanance  is  in  general  overlooked.  However,  with  an  expected  ongoing  evolution  in 
hardware  and  software  implementation  technology,  decisions  should  be  made  with  respect  to  die 
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portability  and  geoerity  of  software  systems.  The  profits  of  portability  and  geaedty  must  be  in 
equilibrium  widi  performance  requirements. 

Conunerdally  available  software  that  suit  with  the  spedGtd  requirements  should  be  ^jplied  when 
its  quality  has  been  confirmed  and  profit  is  evident 

12.6  System  management 

A  c(»sistent  system  can  only  exist  when  die  quality  of  the  individual  modules  is  assured.  To  see 
to  diat  a  system  manager  should  be  iqipointed,  i^o  also  has  the  task  of  system  integration. 

12.7  Legal  aspects 

It  is  not  the  FEL-TNO  policy  to  apply  for  a  patent  at  any  cost.  There  where  possibilities  arise  in 
the  interest  of  FEL-TNO  and/or  its  collaborating  parmers  a  careful  consideration  will  be  carried 
out  for  each  opportunity.  Gipy  rights  and  document  classifications  will  be  handled  conform  the 
FEL-TNO  regulations  and  agreements. 
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13  MARKET  APPROACH 

13.1  Maiketpull 

Each  hoqntal  in  die  Nedierlanda  will  be  eqoqiped  with  MR  imaging  facilities  by  die  year  2000. 
At  diis  moment  about  6600  MR  wwging  systems  are  installed  worldwide  by  die  main 
manufacturers  Siemens,  General  Electric  and  Toshiba  (Dakins  (1993)).  The  users  of  diose 
systems  need  facilities  to  interactively  visualise,  manipulate  and  analyse  3D  images.  Mainly  due 
to  a  lack  of  computer  power  the  images  are  presented  on  a  slice-by-slice  basis.  High  Performance 
Computing  technology  may  solve  dieir  problems.  However,  suppliers  of  MR  systems  are 
spending  less  on  Research  and  Development  (Dakins  (1993))  leaving  opportunities  to  R&D 
companies  such  as  TNO. 

Radiotreatment  planning  is  (usually)  carried  out  with  the  support  of  PC-based  conqiuter  systems. 
As  a  result  of  the  limited  available  oniqniter  power  a  single  planning  session  may  take  up  to  8 
hours.  High  Performance  Conqputing  technology  can  be  utilised  to  reduce  die  time  for  planning 
and  to  i^ly  patient-  and  user-fiiendly  planning  methods  on  CT  or  MR  images  using  interactive 
visualisation  and  extracticm  tools.  The  market,  however,  is  eiqiected  to  be  narrow  Qess  than  10 
systems  in  the  Netherlands  and  at  most  a  few  hundred  worldwide). 

Neurosurgery  requires  careful  planning  on  the  basis  of  CT  or  MR  images.  This  can  only  be 
achieved  reliably  when  visualisation  and  extraction  tools  are  available.  At  present  these  planning 
procedures  are  carried  out  on  powerful  workstations  limiting  the  time  of  die  surgical  intervention 
to  about  24  hours.  This  time  may  be  furdier  reduced  when  High  Performance  Computing  is 
applied. 

Training  and  simulation  in  a  virtual  environmein  is  gaining  interest  of  the  clinicians.  This  includes 
diagnosis  (Ogle  (1993))  and  surgery  (Satava  (1992)).  Especially  training  of  Minimal  Access 
Surgery  in  a  virtual  reality  is  expected  to  take  a  fli^t  A  1993  market  survey  carried  out  by 
Thomson-CSF  suggests  a  market  size  for  surgery  training  systems  as  large  as  for  MR  imaging 
systems!  (see  die  ESPRIT  m  project  proposal  CLEOPATRA).  Training  systems  are  constructed 
round  about  an  anatomical  modeL  vdiich  should  be  extracted  from  CT  and  MR  images  with  die 
aid  of  High  Perfomiance  Conqmting  tools  for  interactive  visualisation  and  extraction  of  organs. 
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Ttiage,  a  decitkMi  (h.'otocol  to  asaess  the;  status  of  casualties  in  crisis  or  war  situatums,  can  be 
trained  in  a  multi-inedia  environment  (Vossen  (1993)).  Sudi  training  systems  are  not  only 
important  for  training  military  personoel  but  also  for  training  personnel  in  trauma  centres.  In  tbe 
Netberiands,  far**  university  hospital  supports  a  trauma  centre.  Virtual  reality,  generated  with 
High  Performance  Consulting,  may  the  realism  of  casualty  training  aessitms. 

An  anatomical  model  required  for  triage  should  also  be  built  with  the  aid  of  High  Performance 
Consulting  tools  for  interactive  visualisation  and  extraction  of  organs. 

13.2  Technology  push 

MR  and  CT  visualisation,  mansuilation  and  analysis,  radiotreatment  planning,  neurosurgery, 
training  and  simulation  for  radiology,  surgery  and  triage  desperately  need  additional  consuiter 
power  for  registration,  visualisation  and  extraction  purposes.  HPC  hard*  and  software  modules 
should  be  developed  for  the  industries  following  eidier  of  two  qs^roaches:  i)  contracting  by  a 
consiany,  or,  ii)  PROGRAMMATISCHE  BEDRDFSGERICHTE  ONDERSTEUNING  VAN 
MEDISCHE  STRAUNGSTOEPASSINGEN  (Dumay  et  al.  (1993)).  Tlie  first  approach  is 
consMmy-driven,  die  latter  is  branch-driven  aiming  at  forming  a  Nederlands  Industrieel  Initiatief 
to  support  each  branch.  Such  an  initiative  should  be  taken  by  TNG  and  a  choice  of  TNO-institutes 
should  particqMte. 

13.3  The  role  of  TNG 

The  TNG  Physics  and  Electronics  Laboratoiy  (TNG-FEL)  excels  in  developing  and  applying 
High  Perfonnaiice  Consulting  technology  (see  also  Paragnqih  3.6)  There  is  a  thorough 
understanding  of  ^iplications  in  the  21  TNO-institutes,  which  can  be  made  availble  to  a  qiecific 
project.  This  understanding  is  based  <m  TNO's  maintenance  of  knowledge  portfolios  and  a  close 
relatiooahq)  with  die  universities  and  industries  in  die  Nedierlands  and  Europe.  The  attractiveness 
for  die  industries  lies  in  die  understanding  of  both  technology  and  applications  within  die  same 
organisation.  In  a  ctmeerted  action  widiin  die  TNG-institutes,  best  results  are  persued  in  die 
interest  of  clients. 


CONCLUSIONS 


Tlie  objective  of  diis  lepoit  is  deacribing  a  brief  inventory  of  potential  areas  in  medicine  where 
High  Perfannance  Computing  (parallel  and  distributed  computing)  technology  is  needed  from  an 
end-user's  point  of  view.  The  potential  areas  are  described  in  detail  to  give  an  understanding  of 
what  it  is  all  about  The  commonality  in  all  diese  areas  is  image  inteqiretation. 

In  this  rqxrrt  we  described  an  introduction  to  the  field  of  medical  imaging  (Cluster  1)  and  the 
positicn  of  a  High  Performance  Con^ting  Medical  Image  Interpretation  System  (HIPMPS) 
therein  (Chapter  2).  The  role  of  High  Perfonnance  Confuting  (HPC),  e^)ecially  of  the  HPC 
Section  at  the  Physics  and  Electronics  Laboratory  TNO,  towards  medical  image  interpretation 
was  outlined  in  Chapta  3.  We  elaborated  on  computer  systems  organisation  (Chapter  4),  software 
system  organisation  (Ctupter  S),  data  formats  and  standards  ((Chapter  6),  database  management 
(Clupter  7),  image  processing  techniques  (dupter  8)  and  pattern  recognition  techniques  (Ch^ter 
9).  In  Chapter  10  we  analysed  some  potential  n^thods  delivered  by  literature,  and  concluded  that 
multi-scale  qiproaches  perform  best  for  image  registration  and  segmentation,  while  for 
visualisation  purposes  more  or  less  standard  techniques  can  be  used.  Evaluation  and 
demonstration  requirements  are  summarised  in  Chapter  11,  and  the  management  of  computing 
and  information  is  described  in  Chapter  12.  A  market  tpproach  by  market  pull,  technology  push  is 
sketched  in  Clupter  13. 

In  medicine,  two  main  areas  can  be  distinguished,  i.e.,  diagnosis  and  treatment.  Diagnosis  is 
applied  in  radiology  (conventional  x-ray  imaging,  ctunputer  tomognphy  (CT),  magnetic 
resonance  imaging  (MRI)  and  magnetic  resonance  angiogra{diy  (MRA),  angiogrtphy, 
arteriography,  digital  subtractitm  angiogrqAy  (DSA),  dual  energy  imaging  and  ultrasound 
techniques)  and  nuclear  medicine  (single  photon  emissicm  computer  tomognphy  (SPECT)  en 
positron  emission  tomography  (PET)).  In  treatment  can  be  named  radiotheiipy  and  surgical 
interventions  like  stereotactical  (neoro-)sur^ry  and  minimal  access  surgery  (MAS).  With  the 
introdurtion  of  computer  systems  in  medicine,  quantitative  analyses  of  2D  images  have  been 
more  or  less  accqited  in  fhe  assessment  of  disease.  Quantitative  Ccuiputed  Tmnognphy  (QCT), 
however,  has  not  found  its  v/sy  to  die  clinics  for  routine  use,  and  die  same  is  about  to  hippen  to 
(Quantitative  Magnetic  Resonance  (QMR)  despite  die  notion  that  all  hospitals  in  the  Netherlands 
will  be  equqped  widi  MR  imaging  facilities  by  the  year  2000.  Tliere  are  several  reasons  debt  to 
diis.  I¥om  die  technology  point  of  view  die  main  reascm  is  the  limited  computer  power  made 
available  to  perform  the  huge  number  of  instructions  to  visualise  3D  images  and  to  interactively 
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extract  regions  of  interests  from  these  images  with  acceptable  performance.  Hence,  currenUy 
commercially  available  systems  visualise  and  process  3D  images  on  a  2D  slice-by-sUce  basis.  In 
literature  many  algorithms  for  ima^e  registration,  inu^e  segmentation  and  image  visualisation  are 
available.  All  these  algorithms  have  been  demonstrated  under  laboratory  conditions,  neglecting 
their  practical  usability.  With  the  advent  of  High  Performance  Computing,  the  urilisarinn  of  these 
algorithms  in  routine  clinical  practise  may  become  feasible. 

In  this  report  we  advocate  and  elaborate  i^n  the  development  of  HPC  modules  for  image 
registration,  segmentation  and  visualisation  to  the  benefit  of  both  the  end  users  (medical 
specialists)  and  the  manufacturing  industries.  Some  of  these  modules  may  be  developed  as  part  of 
the  "Smart  Surgeon"  of  the  ESPRIT  m  project  CLEOPATRA.  These  modules  may  find 
application  in  all  forementioned  areas,  especially  in  radiotherapy  planning  and  training  and 
simulation  in  Virtual  Environments.  TNO  is  about  to  initiate  a  Netherlands  Industrial  Initiative  for 
Radiodiagnostics  and  Radiothenq)y  to  define  a  development  programme  for  some  key  companies 
in  the  health  care  industries  (Dumay  et  al.,  (1993)).  With  the  modules  developed  for  the  "Smart 
Surgeon"  an  anatomical  model  can  be  extracted  from  CT  and  MR  images  for  triage  training  in  a 
virtual  environment  (Dumay  (1993)). 
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